Aug 17 16:17:18 user nova-compute[72724]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 17 16:17:21 user nova-compute[72724]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72724) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72724) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72724) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 17 16:17:21 user nova-compute[72724]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:17:21 user nova-compute[72724]: INFO nova.virt.driver [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 17 16:17:21 user nova-compute[72724]: INFO nova.compute.provider_config [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Acquiring lock "singleton_lock" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Acquired lock "singleton_lock" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Releasing lock "singleton_lock" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Full set of CONF: {{(pid=72724) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ******************************************************************************** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Configuration options gathered from: {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ================================================================================ {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] allow_resize_to_same_host      = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] arq_binding_timeout            = 300 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] backdoor_port                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] backdoor_socket                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] block_device_allocate_retries  = 300 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] block_device_allocate_retries_interval = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cert                           = self.pem {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute_monitors               = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] config_dir                     = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] config_drive_format            = iso9660 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] config_source                  = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] console_host                   = user {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] control_exchange               = nova {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cpu_allocation_ratio           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] daemon                         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] debug                          = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] default_access_ip_network_name = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] default_availability_zone      = nova {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] default_ephemeral_format       = ext4 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] default_schedule_zone          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] disk_allocation_ratio          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] enable_new_services            = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] enabled_apis                   = ['osapi_compute'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] enabled_ssl_apis               = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] flat_injected                  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] force_config_drive             = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] force_raw_images               = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] graceful_shutdown_timeout      = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:21 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] heal_instance_info_cache_interval = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] host                           = user {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_build_timeout         = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_delete_interval       = 300 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_format                = [instance: %(uuid)s]  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_name_template         = instance-%08x {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_usage_audit           = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_usage_audit_period    = month {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] internal_service_availability_zone = internal {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] key                            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] live_migration_retry_count     = 30 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_config_append              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_dir                        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_file                       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_options                    = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_rotate_interval            = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_rotate_interval_type       = days {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] log_rotation_type              = none {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] long_rpc_timeout               = 1800 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] max_concurrent_builds          = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] max_concurrent_live_migrations = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] max_concurrent_snapshots       = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] max_local_block_devices        = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] max_logfile_count              = 30 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] max_logfile_size_mb            = 200 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] maximum_instance_delete_attempts = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metadata_listen                = 0.0.0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metadata_listen_port           = 8775 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metadata_workers               = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] migrate_max_retries            = -1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] mkisofs_cmd                    = genisoimage {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] my_ip                          = 10.0.0.210 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] network_allocate_retries       = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] osapi_compute_listen_port      = 8774 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] osapi_compute_unique_server_name_scope =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] osapi_compute_workers          = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] password_length                = 12 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] periodic_enable                = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] periodic_fuzzy_delay           = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] pointer_model                  = ps2mouse {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] preallocate_images             = none {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] publish_errors                 = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] pybasedir                      = /opt/stack/nova {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ram_allocation_ratio           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rate_limit_burst               = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rate_limit_except_level        = CRITICAL {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rate_limit_interval            = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reboot_timeout                 = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reclaim_instance_interval      = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] record                         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reimage_timeout_per_gb         = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] report_interval                = 120 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rescue_timeout                 = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reserved_host_cpus             = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reserved_host_disk_mb          = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reserved_host_memory_mb        = 512 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] reserved_huge_pages            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] resize_confirm_window          = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] resize_fs_using_block_device   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] resume_guests_state_on_host_boot = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rpc_response_timeout           = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] run_external_periodic_tasks    = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] running_deleted_instance_action = reap {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] running_deleted_instance_poll_interval = 1800 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] running_deleted_instance_timeout = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler_instance_sync_interval = 120 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_down_time              = 720 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] servicegroup_driver            = db {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] shelved_offload_time           = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] shelved_poll_interval          = 3600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] shutdown_timeout               = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] source_is_ipv6                 = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ssl_only                       = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] state_path                     = /opt/stack/data/nova {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] sync_power_state_interval      = 600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] sync_power_state_pool_size     = 1000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] syslog_log_facility            = LOG_USER {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] tempdir                        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] timeout_nbd                    = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] transport_url                  = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] update_resources_interval      = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_cow_images                 = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_eventlog                   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_journal                    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_json                       = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_rootwrap_daemon            = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_stderr                     = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] use_syslog                     = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vcpu_pin_set                   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plugging_is_fatal          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plugging_timeout           = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] virt_mkfs                      = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] volume_usage_poll_interval     = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] watch_log_file                 = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] web                            = /usr/share/spice-html5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_concurrency.disable_process_locking = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.auth_strategy              = keystone {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.compute_link_prefix        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.dhcp_domain                = novalocal {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.enable_instance_password   = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.glance_link_prefix         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.instance_list_per_project_cells = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.list_records_by_skipping_down_cells = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.local_metadata_per_cell    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.max_limit                  = 1000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.metadata_cache_expiration  = 15 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.neutron_default_tenant_id  = default {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.use_forwarded_for          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.use_neutron_default_nets   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_dynamic_targets = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_jsonfile_path   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.backend                  = dogpile.cache.memcached {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.backend_argument         = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.config_prefix            = cache.oslo {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.dead_timeout             = 60.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.debug_cache_backend      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.enable_retry_client      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.enable_socket_keepalive  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.enabled                  = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.expiration_time          = 600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.hashclient_retry_attempts = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_dead_retry      = 300 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_password        =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_pool_maxsize    = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_sasl_enabled    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.memcache_username        =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.proxies                  = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.retry_attempts           = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.retry_delay              = 0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.socket_keepalive_count   = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.socket_keepalive_idle    = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.socket_keepalive_interval = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.tls_allowed_ciphers      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.tls_cafile               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.tls_certfile             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.tls_enabled              = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cache.tls_keyfile              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.auth_section            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.auth_type               = password {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.cafile                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.certfile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.collect_timing          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.cross_az_attach         = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.debug                   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.endpoint_template       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.http_retries            = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.insecure                = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.keyfile                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.os_region_name          = RegionOne {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.split_loggers           = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cinder.timeout                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.cpu_dedicated_set      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.cpu_shared_set         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.image_type_exclude_list = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.max_concurrent_disk_ops = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.max_disk_devices_to_attach = -1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.resource_provider_association_refresh = 300 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.shutdown_retry_interval = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] conductor.workers              = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] console.allowed_origins        = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] console.ssl_ciphers            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] console.ssl_minimum_version    = default {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] consoleauth.token_ttl          = 600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.cafile                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.certfile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.collect_timing          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.connect_retries         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.connect_retry_delay     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.endpoint_override       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.insecure                = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.keyfile                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.max_version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.min_version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.region_name             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.service_name            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.service_type            = accelerator {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.split_loggers           = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.status_code_retries     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.timeout                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] cyborg.version                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.backend               = sqlalchemy {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.connection            = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.connection_debug      = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.connection_parameters =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.connection_recycle_time = 3600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.connection_trace      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.db_inc_retry_interval = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.db_max_retries        = 20 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.db_max_retry_interval = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.db_retry_interval     = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.max_overflow          = 50 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.max_pool_size         = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.max_retries           = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.mysql_enable_ndb      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.mysql_wsrep_sync_wait = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.pool_timeout          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.retry_interval        = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.slave_connection      = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] database.sqlite_synchronous    = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.backend           = sqlalchemy {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.connection        = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.connection_debug  = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.connection_parameters =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.connection_recycle_time = 3600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.connection_trace  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.db_inc_retry_interval = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.db_max_retries    = 20 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.db_max_retry_interval = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.db_retry_interval = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.max_overflow      = 50 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.max_pool_size     = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.max_retries       = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.mysql_enable_ndb  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.pool_timeout      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.retry_interval    = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.slave_connection  = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] api_database.sqlite_synchronous = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] devices.enabled_mdev_types     = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ephemeral_storage_encryption.enabled = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.api_servers             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.cafile                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.certfile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.collect_timing          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.connect_retries         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.connect_retry_delay     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.debug                   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.default_trusted_certificate_ids = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.enable_certificate_validation = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.enable_rbd_download     = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.endpoint_override       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.insecure                = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.keyfile                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.max_version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.min_version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.num_retries             = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.rbd_ceph_conf           =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.rbd_connect_timeout     = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.rbd_pool                =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.rbd_user                =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.region_name             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.service_name            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.service_type            = image {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.split_loggers           = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.status_code_retries     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.timeout                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.verify_glance_signatures = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] glance.version                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] guestfs.debug                  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.config_drive_cdrom      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.config_drive_inject_password = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.enable_instance_metrics_collection = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.enable_remotefx         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.instances_path_share    =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.iscsi_initiator_list    = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.limit_cpu_features      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.power_state_check_timeframe = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.use_multipath_io        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.volume_attach_retry_count = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.vswitch_name            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] mks.enabled                    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] image_cache.manager_interval   = 2400 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] image_cache.precache_concurrency = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] image_cache.remove_unused_base_images = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] image_cache.subdirectory_name  = _base {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.api_max_retries         = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.api_retry_interval      = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.auth_section            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.auth_type               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.cafile                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.certfile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.collect_timing          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.connect_retries         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.connect_retry_delay     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.endpoint_override       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.insecure                = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.keyfile                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.max_version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.min_version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.partition_key           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.peer_list               = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.region_name             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.serial_console_state_timeout = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.service_name            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.service_type            = baremetal {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.split_loggers           = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.status_code_retries     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.timeout                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ironic.version                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] key_manager.fixed_key          = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.barbican_api_version  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.barbican_endpoint     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.barbican_endpoint_type = public {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.barbican_region_name  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.cafile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.certfile              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.collect_timing        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.insecure              = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.keyfile               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.number_of_retries     = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.retry_delay           = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.send_service_user_token = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.split_loggers         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.timeout               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.verify_ssl            = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican.verify_ssl_path       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.auth_section = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.auth_type = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.cafile   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.certfile = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.collect_timing = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.insecure = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.keyfile  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.split_loggers = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] barbican_service_user.timeout  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.approle_role_id          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.approle_secret_id        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.cafile                   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.certfile                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.collect_timing           = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.insecure                 = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.keyfile                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.kv_mountpoint            = secret {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.kv_version               = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.namespace                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.root_token_id            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.split_loggers            = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.ssl_ca_crt_file          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.timeout                  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.use_ssl                  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.cafile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.certfile              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.collect_timing        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.connect_retries       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.connect_retry_delay   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.endpoint_override     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.insecure              = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.keyfile               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.max_version           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.min_version           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.region_name           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.service_name          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.service_type          = identity {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.split_loggers         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.status_code_retries   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.timeout               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] keystone.version               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.connection_uri         =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_mode               = custom {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: WARNING oslo_config.cfg [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_power_governor_high = performance {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_power_governor_low = powersave {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_power_management   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.device_detach_attempts = 8 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.device_detach_timeout  = 20 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.disk_cachemodes        = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.disk_prefix            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.enabled_perf_events    = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.file_backed_memory     = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.gid_maps               = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.hw_disk_discard        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.hw_machine_type        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_rbd_glance_store_name =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_rbd_pool        = rbd {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_type            = default {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.images_volume_group    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.inject_key             = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.inject_partition       = -2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.inject_password        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.iscsi_iface            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.iser_use_multipath     = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_bandwidth = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_downtime = 500 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_inbound_addr = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_permit_post_copy = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_scheme  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_timeout_action = abort {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_tunnelled = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: WARNING oslo_config.cfg [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 17 16:17:22 user nova-compute[72724]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 17 16:17:22 user nova-compute[72724]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 17 16:17:22 user nova-compute[72724]: and ``live_migration_inbound_addr`` respectively.
Aug 17 16:17:22 user nova-compute[72724]: ).  Its value may be silently ignored in the future.
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.live_migration_with_native_tls = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.max_queues             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.nfs_mount_options      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.num_memory_encrypted_guests = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.num_pcie_ports         = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.pmem_namespaces        = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.quobyte_client_cfg     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rbd_secret_uuid        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rbd_user               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.remote_filesystem_transport = ssh {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rescue_image_id        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rescue_kernel_id       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rescue_ramdisk_id      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.rx_queue_size          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.smbfs_mount_options    =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.snapshot_compression   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.snapshot_image_format  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.sparse_logical_volumes = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.swtpm_enabled          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.swtpm_group            = tss {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.swtpm_user             = tss {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.sysinfo_serial         = unique {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.tb_cache_size          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.tx_queue_size          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.uid_maps               = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.use_virtio_for_bridges = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.virt_type              = kvm {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.volume_clear           = zero {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.volume_clear_size      = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.volume_use_multipath   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_cache_path   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.vzstorage_mount_user   = stack {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.auth_section           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.auth_type              = password {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.cafile                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.certfile               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.collect_timing         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.connect_retries        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.connect_retry_delay    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.default_floating_pool  = public {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.endpoint_override      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.extension_sync_interval = 600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.http_retries           = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.insecure               = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.keyfile                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.max_version            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.min_version            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.ovs_bridge             = br-int {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.physnets               = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.region_name            = RegionOne {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.service_metadata_proxy = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.service_name           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.service_type           = network {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.split_loggers          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.status_code_retries    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.timeout                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] neutron.version                = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] notifications.bdms_in_notifications = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] notifications.default_level    = INFO {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] notifications.notification_format = unversioned {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] notifications.notify_on_state_change = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] pci.alias                      = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] pci.device_spec                = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] pci.report_in_placement        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.auth_section         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.auth_type            = password {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.cafile               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.certfile             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.collect_timing       = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.connect_retries      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.connect_retry_delay  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.default_domain_id    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.default_domain_name  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.domain_id            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.domain_name          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.endpoint_override    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.insecure             = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.keyfile              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.max_version          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.min_version          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.password             = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.project_domain_id    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.project_domain_name  = Default {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.project_id           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.project_name         = service {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.region_name          = RegionOne {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.service_name         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.service_type         = placement {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.split_loggers        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.status_code_retries  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.system_scope         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.timeout              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.trust_id             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.user_domain_id       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.user_domain_name     = Default {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.user_id              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.username             = placement {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] placement.version              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.cores                    = 20 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.count_usage_from_placement = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.injected_file_content_bytes = 10240 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.injected_file_path_length = 255 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.injected_files           = 5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.instances                = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.key_pairs                = 100 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.metadata_items           = 128 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.ram                      = 51200 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.recheck_quota            = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.server_group_members     = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] quota.server_groups            = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rdp.enabled                    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.image_metadata_prefilter = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.max_attempts         = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.max_placement_results = 1000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.query_placement_for_availability_zone = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.query_placement_for_image_type_support = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] scheduler.workers              = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.host_subset_size = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.isolated_hosts = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.isolated_images = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.pci_in_placement = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.track_instance_changes = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metrics.required               = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metrics.weight_multiplier      = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] metrics.weight_setting         = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] serial_console.enabled         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] serial_console.port_range      = 10000:20000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] serial_console.serialproxy_port = 6083 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.auth_section      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.auth_type         = password {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.cafile            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.certfile          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.collect_timing    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.insecure          = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.keyfile           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.send_service_user_token = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.split_loggers     = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] service_user.timeout           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.agent_enabled            = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.enabled                  = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.html5proxy_port          = 6082 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.image_compression        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.jpeg_compression         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.playback_compression     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.server_listen            = 127.0.0.1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.streaming_mode           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] spice.zlib_compression         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] upgrade_levels.baseapi         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] upgrade_levels.cert            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] upgrade_levels.compute         = auto {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] upgrade_levels.conductor       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] upgrade_levels.scheduler       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.auth_section = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.auth_type = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.cafile = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.certfile = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.insecure = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.keyfile = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vendordata_dynamic_auth.timeout = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.api_retry_count         = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.ca_file                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.cache_prefix            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.cluster_name            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.connection_pool_size    = 10 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.console_delay_seconds   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.datastore_regex         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.host_ip                 = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.host_password           = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.host_port               = 443 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.host_username           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.insecure                = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.integration_bridge      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.maximum_objects         = 100 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.pbm_default_policy      = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.pbm_enabled             = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.pbm_wsdl_location       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.serial_port_proxy_uri   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.serial_port_service_uri = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.task_poll_interval      = 0.5 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.use_linked_clone        = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.vnc_keymap              = en-us {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.vnc_port                = 5900 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vmware.vnc_port_total          = 10000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.auth_schemes               = ['none'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.enabled                    = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.novncproxy_port            = 6080 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.server_listen              = 0.0.0.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.vencrypt_ca_certs          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.vencrypt_client_cert       = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vnc.vencrypt_client_key        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.disable_rootwrap   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.enable_numa_live_migration = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.libvirt_disable_apic = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.client_socket_timeout     = 900 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.default_pool_size         = 1000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.keep_alive                = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.max_header_line           = 16384 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.ssl_ca_file               = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.ssl_cert_file             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.ssl_key_file              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.tcp_keepidle              = 600 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] zvm.ca_file                    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] zvm.cloud_connector_url        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] zvm.reachable_timeout          = 300 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.enforce_new_defaults = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.enforce_scope      = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.policy_default_rule = default {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.policy_file        = policy.yaml {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.connection_string     = messaging:// {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.enabled               = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.es_doc_type           = notification {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.es_scroll_size        = 10000 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.es_scroll_time        = 2m {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.filter_error_trace    = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.hmac_keys             = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.sentinel_service_name = mymaster {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.socket_timeout        = 0.1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.trace_requests        = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler.trace_sqlalchemy      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler_jaeger.process_tags   = {} {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler_jaeger.service_name_prefix = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] profiler_otlp.service_name_prefix = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] remote_debug.host              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] remote_debug.port              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.ssl      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_notifications.retry = -1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_messaging_notifications.transport_url = **** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.auth_section        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.auth_type           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.cafile              = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.certfile            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.collect_timing      = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.connect_retries     = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.connect_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.endpoint_id         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.endpoint_override   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.insecure            = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.keyfile             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.max_version         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.min_version         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.region_name         = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.service_name        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.service_type        = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.split_loggers       = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.status_code_retries = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.status_code_retry_delay = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.timeout             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.valid_interfaces    = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_limit.version             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_reports.file_event_handler = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] oslo_reports.log_dir           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_ovs_privileged.group  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] vif_plug_ovs_privileged.user   = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.flat_interface = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_ovs.isolate_vif         = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_vif_ovs.per_port_bridge     = False {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] os_brick.lock_path             = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] privsep_osbrick.capabilities   = [21] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] privsep_osbrick.group          = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] privsep_osbrick.helper_command = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] privsep_osbrick.user           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] nova_sys_admin.group           = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] nova_sys_admin.helper_command  = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] nova_sys_admin.user            = None {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG oslo_service.service [None req-70354f94-f1e4-42a2-8fcb-2776f03f595b None None] ******************************************************************************** {{(pid=72724) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 17 16:17:22 user nova-compute[72724]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Starting native event thread {{(pid=72724) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Starting green dispatch thread {{(pid=72724) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Starting connection event dispatch thread {{(pid=72724) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Connecting to libvirt: qemu:///system {{(pid=72724) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f86e9240f70> {{(pid=72724) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f86e9240f70> {{(pid=72724) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 17 16:17:22 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Connection event '1' reason 'None'
Aug 17 16:17:22 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 16:17:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.mount [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Initialising _HostMountState generation 0 {{(pid=72724) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 17 16:17:29 user nova-compute[72724]: INFO nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host capabilities <capabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <host>
Aug 17 16:17:29 user nova-compute[72724]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 17 16:17:29 user nova-compute[72724]:     <cpu>
Aug 17 16:17:29 user nova-compute[72724]:       <arch>x86_64</arch>
Aug 17 16:17:29 user nova-compute[72724]:       <model>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <microcode version='1070'/>
Aug 17 16:17:29 user nova-compute[72724]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='osxsave'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='invtsc'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='rsba'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature name='skip-l1dfl-vmentry'/>
Aug 17 16:17:29 user nova-compute[72724]:       <pages unit='KiB' size='4'/>
Aug 17 16:17:29 user nova-compute[72724]:       <pages unit='KiB' size='2048'/>
Aug 17 16:17:29 user nova-compute[72724]:     </cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <power_management>
Aug 17 16:17:29 user nova-compute[72724]:       <suspend_mem/>
Aug 17 16:17:29 user nova-compute[72724]:       <suspend_disk/>
Aug 17 16:17:29 user nova-compute[72724]:       <suspend_hybrid/>
Aug 17 16:17:29 user nova-compute[72724]:     </power_management>
Aug 17 16:17:29 user nova-compute[72724]:     <iommu support='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <migration_features>
Aug 17 16:17:29 user nova-compute[72724]:       <live/>
Aug 17 16:17:29 user nova-compute[72724]:       <uri_transports>
Aug 17 16:17:29 user nova-compute[72724]:         <uri_transport>tcp</uri_transport>
Aug 17 16:17:29 user nova-compute[72724]:         <uri_transport>rdma</uri_transport>
Aug 17 16:17:29 user nova-compute[72724]:       </uri_transports>
Aug 17 16:17:29 user nova-compute[72724]:     </migration_features>
Aug 17 16:17:29 user nova-compute[72724]:     <topology>
Aug 17 16:17:29 user nova-compute[72724]:       <cells num='2'>
Aug 17 16:17:29 user nova-compute[72724]:         <cell id='0'>
Aug 17 16:17:29 user nova-compute[72724]:           <memory unit='KiB'>8140616</memory>
Aug 17 16:17:29 user nova-compute[72724]:           <pages unit='KiB' size='4'>2035154</pages>
Aug 17 16:17:29 user nova-compute[72724]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 16:17:29 user nova-compute[72724]:           <distances>
Aug 17 16:17:29 user nova-compute[72724]:             <sibling id='0' value='10'/>
Aug 17 16:17:29 user nova-compute[72724]:             <sibling id='1' value='20'/>
Aug 17 16:17:29 user nova-compute[72724]:           </distances>
Aug 17 16:17:29 user nova-compute[72724]:           <cpus num='6'>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 17 16:17:29 user nova-compute[72724]:           </cpus>
Aug 17 16:17:29 user nova-compute[72724]:         </cell>
Aug 17 16:17:29 user nova-compute[72724]:         <cell id='1'>
Aug 17 16:17:29 user nova-compute[72724]:           <memory unit='KiB'>8255068</memory>
Aug 17 16:17:29 user nova-compute[72724]:           <pages unit='KiB' size='4'>2063767</pages>
Aug 17 16:17:29 user nova-compute[72724]:           <pages unit='KiB' size='2048'>0</pages>
Aug 17 16:17:29 user nova-compute[72724]:           <distances>
Aug 17 16:17:29 user nova-compute[72724]:             <sibling id='0' value='20'/>
Aug 17 16:17:29 user nova-compute[72724]:             <sibling id='1' value='10'/>
Aug 17 16:17:29 user nova-compute[72724]:           </distances>
Aug 17 16:17:29 user nova-compute[72724]:           <cpus num='6'>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 17 16:17:29 user nova-compute[72724]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 17 16:17:29 user nova-compute[72724]:           </cpus>
Aug 17 16:17:29 user nova-compute[72724]:         </cell>
Aug 17 16:17:29 user nova-compute[72724]:       </cells>
Aug 17 16:17:29 user nova-compute[72724]:     </topology>
Aug 17 16:17:29 user nova-compute[72724]:     <cache>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 17 16:17:29 user nova-compute[72724]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 17 16:17:29 user nova-compute[72724]:     </cache>
Aug 17 16:17:29 user nova-compute[72724]:     <secmodel>
Aug 17 16:17:29 user nova-compute[72724]:       <model>apparmor</model>
Aug 17 16:17:29 user nova-compute[72724]:       <doi>0</doi>
Aug 17 16:17:29 user nova-compute[72724]:     </secmodel>
Aug 17 16:17:29 user nova-compute[72724]:     <secmodel>
Aug 17 16:17:29 user nova-compute[72724]:       <model>dac</model>
Aug 17 16:17:29 user nova-compute[72724]:       <doi>0</doi>
Aug 17 16:17:29 user nova-compute[72724]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 17 16:17:29 user nova-compute[72724]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 17 16:17:29 user nova-compute[72724]:     </secmodel>
Aug 17 16:17:29 user nova-compute[72724]:   </host>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='alpha'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>clipper</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='armv6l'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>spitz</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>nuri</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>kzm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sx1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>z2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>tosa</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>n810</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>n800</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>terrier</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>midway</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>microbit</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>verdex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>highbank</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>akita</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>connex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>collie</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='armv7l'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>spitz</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>nuri</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>kzm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sx1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>z2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>tosa</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>n810</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>n800</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>terrier</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>midway</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>microbit</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>verdex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>highbank</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>akita</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>connex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>collie</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='aarch64'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>integratorcp</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>borzoi</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>spitz</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>nuri</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>musca-b1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>versatileab</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>kzm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>musca-a</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>smdkc210</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sx1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>z2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>tosa</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>sabrelite</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>realview-eb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>n810</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>n800</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>versatilepb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>terrier</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mainstone</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>midway</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>musicpal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>microbit</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>cubieboard</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>verdex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>netduino2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>raspi3b</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>raspi2b</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>cheetah</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>highbank</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>akita</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>connex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>collie</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>raspi0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <acpi default='on' toggle='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='cris'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='i686'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>isapc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>microvm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='kvm'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <pae/>
Aug 17 16:17:29 user nova-compute[72724]:       <nonpae/>
Aug 17 16:17:29 user nova-compute[72724]:       <acpi default='on' toggle='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:       <apic default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='m68k'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>an5206</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>q800</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>next-cube</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='microblaze'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='microblazeel'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='mips'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='16'>malta</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='mipsel'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='16'>malta</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='mips64'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='16'>malta</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>pica61</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>magnum</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='mips64el'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='16'>malta</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mipssim</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>pica61</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>magnum</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='16'>boston</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='ppc'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mac99</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>40p</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>taihu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='ppc64'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>taihu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>40p</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mac99</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='ppc64le'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2048'>powernv9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>taihu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2048'>powernv10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ppce500</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>40p</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>pegasos2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>bamboo</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>g3beige</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>mac99</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sam460ex</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>ref405ep</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2048'>powernv8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='riscv32'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='8'>spike</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>opentitan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='8'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='riscv64'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='8'>spike</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='5'>sifive_u</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>shakti_c</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sifive_e</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='8'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='s390x'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='sh4'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>shix</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>r2d</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='sh4eb'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>shix</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>r2d</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='sparc'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>SS-5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>SS-20</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>LX</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>SS-4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>SS-10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>Voyager</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='sparc64'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sun4u</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>niagara</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>sun4v</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='x86_64'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>64</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>x-remote</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='1'>isapc</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>microvm</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='kvm'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <acpi default='on' toggle='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:       <apic default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='xtensa'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>sim</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>kc705</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ml605</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx200</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx60</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]:   <guest>
Aug 17 16:17:29 user nova-compute[72724]:     <os_type>hvm</os_type>
Aug 17 16:17:29 user nova-compute[72724]:     <arch name='xtensaeb'>
Aug 17 16:17:29 user nova-compute[72724]:       <wordsize>32</wordsize>
Aug 17 16:17:29 user nova-compute[72724]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='4'>sim</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>kc705</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ml605</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>virt</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx200</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>lx60</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 17 16:17:29 user nova-compute[72724]:       <domain type='qemu'/>
Aug 17 16:17:29 user nova-compute[72724]:     </arch>
Aug 17 16:17:29 user nova-compute[72724]:     <features>
Aug 17 16:17:29 user nova-compute[72724]:       <cpuselection/>
Aug 17 16:17:29 user nova-compute[72724]:       <deviceboot/>
Aug 17 16:17:29 user nova-compute[72724]:       <disksnapshot default='on' toggle='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     </features>
Aug 17 16:17:29 user nova-compute[72724]:   </guest>
Aug 17 16:17:29 user nova-compute[72724]: </capabilities>
Aug 17 16:17:29 user nova-compute[72724]: 
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for i686 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-q35-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>i686</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='288'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'/>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='lm'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-i440fx-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>i686</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='255'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'/>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='lm'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ide</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-q35-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>i686</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='288'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'/>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='lm'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-i386</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-i440fx-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>i686</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='255'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'/>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='lm'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ide</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for x86_64 via machine types: {'q35', 'ubuntu', 'ubuntu-q35', 'pc'} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-q35-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>x86_64</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='288'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>efi</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='invtsc'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='rsba'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-i440fx-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>x86_64</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='255'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>efi</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='invtsc'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='rsba'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ide</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-q35-jammy</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>x86_64</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='288'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>efi</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='invtsc'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='rsba'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 17 16:17:29 user nova-compute[72724]: <domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 17 16:17:29 user nova-compute[72724]:   <domain>kvm</domain>
Aug 17 16:17:29 user nova-compute[72724]:   <machine>pc-i440fx-6.2</machine>
Aug 17 16:17:29 user nova-compute[72724]:   <arch>x86_64</arch>
Aug 17 16:17:29 user nova-compute[72724]:   <vcpu max='255'/>
Aug 17 16:17:29 user nova-compute[72724]:   <iothreads supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:   <os supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='firmware'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>efi</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:     <loader supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>rom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pflash</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='readonly'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>yes</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='secure'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>no</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </loader>
Aug 17 16:17:29 user nova-compute[72724]:   </os>
Aug 17 16:17:29 user nova-compute[72724]:   <cpu>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-passthrough' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='hostPassthroughMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='maximum' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='maximumMigratable'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>on</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>off</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='host-model' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <vendor>Intel</vendor>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ss'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='vmx'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pcid'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='hypervisor'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arat'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='tsc_adjust'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='umip'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='md-clear'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='arch-capabilities'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='invtsc'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibpb'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='ibrs'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-stibp'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='amd-ssbd'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='rsba'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='require' name='pschange-mc-no'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='erms'/>
Aug 17 16:17:29 user nova-compute[72724]:       <feature policy='disable' name='xsaveopt'/>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:     <mode name='custom' supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>qemu64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>qemu32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>phenom</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>pentium</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>n270</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm64</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>kvm32</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>coreduo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>core2duo</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>athlon</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Westmere</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Snowridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Skylake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>SandyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Penryn</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G5</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G4</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G3</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Opteron_G2</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Opteron_G1</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>IvyBridge</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Icelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Haswell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Rome</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-Milan</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC-IBPB</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>EPYC</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Dhyana</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cooperlake</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>Conroe</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Cascadelake-Server</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-noTSX</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell-IBRS</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='no'>Broadwell</model>
Aug 17 16:17:29 user nova-compute[72724]:       <model usable='yes'>486</model>
Aug 17 16:17:29 user nova-compute[72724]:     </mode>
Aug 17 16:17:29 user nova-compute[72724]:   </cpu>
Aug 17 16:17:29 user nova-compute[72724]:   <memoryBacking supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:     <enum name='sourceType'>
Aug 17 16:17:29 user nova-compute[72724]:       <value>file</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>anonymous</value>
Aug 17 16:17:29 user nova-compute[72724]:       <value>memfd</value>
Aug 17 16:17:29 user nova-compute[72724]:     </enum>
Aug 17 16:17:29 user nova-compute[72724]:   </memoryBacking>
Aug 17 16:17:29 user nova-compute[72724]:   <devices>
Aug 17 16:17:29 user nova-compute[72724]:     <disk supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='diskDevice'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>disk</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cdrom</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>floppy</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>lun</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='bus'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ide</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>fdc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sata</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </disk>
Aug 17 16:17:29 user nova-compute[72724]:     <graphics supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='type'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>sdl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vnc</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>spice</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egl-headless</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </graphics>
Aug 17 16:17:29 user nova-compute[72724]:     <video supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='modelType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>cirrus</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>vmvga</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>qxl</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>none</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>bochs</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>ramfb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </video>
Aug 17 16:17:29 user nova-compute[72724]:     <hostdev supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='mode'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>subsystem</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='startupPolicy'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>default</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>mandatory</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>requisite</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>optional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='subsysType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>usb</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>pci</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>scsi</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='capsType'/>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='pciBackend'/>
Aug 17 16:17:29 user nova-compute[72724]:     </hostdev>
Aug 17 16:17:29 user nova-compute[72724]:     <rng supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtio-non-transitional</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>random</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>egd</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>builtin</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </rng>
Aug 17 16:17:29 user nova-compute[72724]:     <filesystem supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='driverType'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>path</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>handle</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>virtiofs</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </filesystem>
Aug 17 16:17:29 user nova-compute[72724]:     <tpm supported='yes'>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='model'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-tis</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>tpm-crb</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:       <enum name='backendModel'>
Aug 17 16:17:29 user nova-compute[72724]:         <value>passthrough</value>
Aug 17 16:17:29 user nova-compute[72724]:         <value>emulator</value>
Aug 17 16:17:29 user nova-compute[72724]:       </enum>
Aug 17 16:17:29 user nova-compute[72724]:     </tpm>
Aug 17 16:17:29 user nova-compute[72724]:   </devices>
Aug 17 16:17:29 user nova-compute[72724]:   <features>
Aug 17 16:17:29 user nova-compute[72724]:     <gic supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:     <vmcoreinfo supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <genid supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backingStoreInput supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <backup supported='yes'/>
Aug 17 16:17:29 user nova-compute[72724]:     <sev supported='no'/>
Aug 17 16:17:29 user nova-compute[72724]:   </features>
Aug 17 16:17:29 user nova-compute[72724]: </domainCapabilities>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72724) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72724) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Checking secure boot support for host arch (x86_64) {{(pid=72724) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 17 16:17:29 user nova-compute[72724]: INFO nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Secure Boot support detected
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] cpu compare xml: <cpu match="exact">
Aug 17 16:17:29 user nova-compute[72724]:   <model>Nehalem</model>
Aug 17 16:17:29 user nova-compute[72724]: </cpu>
Aug 17 16:17:29 user nova-compute[72724]:  {{(pid=72724) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 17 16:17:29 user nova-compute[72724]: INFO nova.virt.node [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Generated node identity 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1
Aug 17 16:17:29 user nova-compute[72724]: INFO nova.virt.node [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Wrote node identity 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 to /opt/stack/data/nova/compute_id
Aug 17 16:17:29 user nova-compute[72724]: WARNING nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Compute nodes ['754b4011-d0b6-4fa1-8aed-3fbcbaa664d1'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 17 16:17:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 17 16:17:29 user nova-compute[72724]: WARNING nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 17 16:17:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:17:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:17:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Hypervisor/Node resource view: name=user free_ram=10961MB free_disk=26.461994171142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:17:29 user nova-compute[72724]: WARNING nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] No compute node record for user:754b4011-d0b6-4fa1-8aed-3fbcbaa664d1: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 could not be found.
Aug 17 16:17:29 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Compute node record created for user:user with uuid: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:17:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:17:30 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [req-352b05b2-3b52-4112-8750-065e8b962b0f] Created resource provider record via placement API for resource provider with UUID 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 and name user.
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72724) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 17 16:17:30 user nova-compute[72724]: INFO nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] kernel doesn't support AMD SEV
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Libvirt baseline CPU <cpu>
Aug 17 16:17:30 user nova-compute[72724]:   <arch>x86_64</arch>
Aug 17 16:17:30 user nova-compute[72724]:   <model>Nehalem</model>
Aug 17 16:17:30 user nova-compute[72724]:   <vendor>Intel</vendor>
Aug 17 16:17:30 user nova-compute[72724]:   <topology sockets="6" cores="1" threads="1"/>
Aug 17 16:17:30 user nova-compute[72724]: </cpu>
Aug 17 16:17:30 user nova-compute[72724]:  {{(pid=72724) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Updated inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Updating resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 generation from 0 to 1 during operation: update_inventory {{(pid=72724) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Updating resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 generation from 1 to 2 during operation: update_traits {{(pid=72724) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.593s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.service [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Creating RPC server for service compute {{(pid=72724) start /opt/stack/nova/nova/service.py:182}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.service [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Join ServiceGroup membership for this service compute {{(pid=72724) start /opt/stack/nova/nova/service.py:199}}
Aug 17 16:17:30 user nova-compute[72724]: DEBUG nova.servicegroup.drivers.db [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72724) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:18:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:18:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=10248MB free_disk=26.365707397460938GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:19:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:19:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:19:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:19:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=10240MB free_disk=26.41176986694336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:19:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.110s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:19:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:19:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:20:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:20:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:20:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:20:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:20:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=10244MB free_disk=26.195899963378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:20:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:21:27 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:27 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:27 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=9487MB free_disk=26.217884063720703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:21:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:21:32 user nova-compute[72724]: INFO nova.compute.claims [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Claim successful on node user
Aug 17 16:21:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:21:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:21:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:21:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Creating image(s)
Aug 17 16:21:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "/opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "/opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "/opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:33 user nova-compute[72724]: DEBUG nova.policy [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5984e05fc507464e9912f8666a0513ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2281f26e94004b718a3b213565bb52cb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:21:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.part --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:34 user nova-compute[72724]: DEBUG nova.virt.images [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:21:34 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:21:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.part /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.part /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.converted" returned: 0 in 0.323s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.957s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:35 user nova-compute[72724]: INFO oslo.privsep.daemon [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpn16j14lk/privsep.sock']
Aug 17 16:21:35 user sudo[82032]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpn16j14lk/privsep.sock
Aug 17 16:21:35 user sudo[82032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 16:21:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Successfully created port: c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:21:37 user sudo[82032]: pam_unix(sudo:session): session closed for user root
Aug 17 16:21:37 user nova-compute[72724]: INFO oslo.privsep.daemon [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Spawned new privsep daemon via rootwrap
Aug 17 16:21:37 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 16:21:37 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 16:21:37 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 17 16:21:37 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82035
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk 1073741824" returned: 0 in 0.048s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.166s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:21:38 user nova-compute[72724]: INFO nova.compute.claims [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Claim successful on node user
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Cannot resize image /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lazy-loading 'migration_context' on Instance uuid 6012ffd1-9d5e-48e3-8331-303109d68e0f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Ensure instance console log exists: /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Successfully updated port: c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquired lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:21:38 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.policy [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd21c9e7f6c3546fbaabef5fef9ba367e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e8428c63a474e2bb1d26c44c7a0e2c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-changed-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Refreshing instance network info cache due to event network-changed-c376d81c-d404-4f58-a623-8aa2b7181f0a. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] Acquiring lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:21:38 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Creating image(s)
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk 1073741824" returned: 0 in 0.048s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.153s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Cannot resize image /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'migration_context' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Ensure instance console log exists: /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updating instance_info_cache with network_info: [{"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Releasing lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Instance network_info: |[{"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] Acquired lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.network.neutron [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Refreshing network info cache for port c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Start _get_guest_xml network_info=[{"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:21:40 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:40 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2072044573',display_name='tempest-DeleteServersTestJSON-server-2072044573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2072044573',id=1,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2281f26e94004b718a3b213565bb52cb',ramdisk_id='',reservation_id='r-xrg1ytll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-982797275',owner_user_name='tempest-DeleteServersTestJSON-982797275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:33Z,user_data=None,user_id='5984e05fc507464e9912f8666a0513ac',uuid=6012ffd1-9d5e-48e3-8331-303109d68e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Converting VIF {"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lazy-loading 'pci_devices' on Instance uuid 6012ffd1-9d5e-48e3-8331-303109d68e0f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:21:40 user nova-compute[72724]:   <uuid>6012ffd1-9d5e-48e3-8331-303109d68e0f</uuid>
Aug 17 16:21:40 user nova-compute[72724]:   <name>instance-00000001</name>
Aug 17 16:21:40 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:21:40 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:21:40 user nova-compute[72724]:   <metadata>
Aug 17 16:21:40 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:21:40 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:21:40 user nova-compute[72724]:       <nova:name>tempest-DeleteServersTestJSON-server-2072044573</nova:name>
Aug 17 16:21:40 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:21:40</nova:creationTime>
Aug 17 16:21:40 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:21:40 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:21:40 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:21:40 user nova-compute[72724]:       <nova:owner>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:user uuid="5984e05fc507464e9912f8666a0513ac">tempest-DeleteServersTestJSON-982797275-project-member</nova:user>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:project uuid="2281f26e94004b718a3b213565bb52cb">tempest-DeleteServersTestJSON-982797275</nova:project>
Aug 17 16:21:40 user nova-compute[72724]:       </nova:owner>
Aug 17 16:21:40 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:21:40 user nova-compute[72724]:       <nova:ports>
Aug 17 16:21:40 user nova-compute[72724]:         <nova:port uuid="c376d81c-d404-4f58-a623-8aa2b7181f0a">
Aug 17 16:21:40 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:21:40 user nova-compute[72724]:         </nova:port>
Aug 17 16:21:40 user nova-compute[72724]:       </nova:ports>
Aug 17 16:21:40 user nova-compute[72724]:     </nova:instance>
Aug 17 16:21:40 user nova-compute[72724]:   </metadata>
Aug 17 16:21:40 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:21:40 user nova-compute[72724]:     <system>
Aug 17 16:21:40 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:21:40 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:21:40 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:21:40 user nova-compute[72724]:       <entry name="serial">6012ffd1-9d5e-48e3-8331-303109d68e0f</entry>
Aug 17 16:21:40 user nova-compute[72724]:       <entry name="uuid">6012ffd1-9d5e-48e3-8331-303109d68e0f</entry>
Aug 17 16:21:40 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:21:40 user nova-compute[72724]:     </system>
Aug 17 16:21:40 user nova-compute[72724]:   </sysinfo>
Aug 17 16:21:40 user nova-compute[72724]:   <os>
Aug 17 16:21:40 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:21:40 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:21:40 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:21:40 user nova-compute[72724]:   </os>
Aug 17 16:21:40 user nova-compute[72724]:   <features>
Aug 17 16:21:40 user nova-compute[72724]:     <acpi/>
Aug 17 16:21:40 user nova-compute[72724]:     <apic/>
Aug 17 16:21:40 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:21:40 user nova-compute[72724]:   </features>
Aug 17 16:21:40 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:21:40 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:21:40 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:21:40 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:21:40 user nova-compute[72724]:   </clock>
Aug 17 16:21:40 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:21:40 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:21:40 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:21:40 user nova-compute[72724]:   </cpu>
Aug 17 16:21:40 user nova-compute[72724]:   <devices>
Aug 17 16:21:40 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:21:40 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:21:40 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk"/>
Aug 17 16:21:40 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:21:40 user nova-compute[72724]:     </disk>
Aug 17 16:21:40 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:21:40 user nova-compute[72724]:       <mac address="fa:16:3e:84:e9:0b"/>
Aug 17 16:21:40 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:40 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:21:40 user nova-compute[72724]:       <target dev="tapc376d81c-d4"/>
Aug 17 16:21:40 user nova-compute[72724]:     </interface>
Aug 17 16:21:40 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:21:40 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/console.log" append="off"/>
Aug 17 16:21:40 user nova-compute[72724]:     </serial>
Aug 17 16:21:40 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:21:40 user nova-compute[72724]:     <video>
Aug 17 16:21:40 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:40 user nova-compute[72724]:     </video>
Aug 17 16:21:40 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:21:40 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:21:40 user nova-compute[72724]:     </rng>
Aug 17 16:21:40 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:21:40 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:21:40 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:21:40 user nova-compute[72724]:     </memballoon>
Aug 17 16:21:40 user nova-compute[72724]:   </devices>
Aug 17 16:21:40 user nova-compute[72724]: </domain>
Aug 17 16:21:40 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2072044573',display_name='tempest-DeleteServersTestJSON-server-2072044573',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2072044573',id=1,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2281f26e94004b718a3b213565bb52cb',ramdisk_id='',reservation_id='r-xrg1ytll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-982797275',owner_user_name='tempest-DeleteServersTestJSON-982797275-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:33Z,user_data=None,user_id='5984e05fc507464e9912f8666a0513ac',uuid=6012ffd1-9d5e-48e3-8331-303109d68e0f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Converting VIF {"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG os_vif [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Created schema index Interface.name {{(pid=72724) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Created schema index Port.name {{(pid=72724) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Created schema index Bridge.name {{(pid=72724) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [POLLOUT] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:21:40 user nova-compute[72724]: INFO oslo.privsep.daemon [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp_49wj_re/privsep.sock']
Aug 17 16:21:40 user sudo[82078]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp_49wj_re/privsep.sock
Aug 17 16:21:40 user sudo[82078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 16:21:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Successfully created port: 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:21:42 user nova-compute[72724]: DEBUG nova.network.neutron [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updated VIF entry in instance network info cache for port c376d81c-d404-4f58-a623-8aa2b7181f0a. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:21:42 user nova-compute[72724]: DEBUG nova.network.neutron [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updating instance_info_cache with network_info: [{"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-26bd67a2-1008-488c-b61d-affd87d5c74e req-8b1b556a-62ef-45be-a413-f446fcd8b8e3 service nova] Releasing lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:42 user sudo[82078]: pam_unix(sudo:session): session closed for user root
Aug 17 16:21:42 user nova-compute[72724]: INFO oslo.privsep.daemon [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Spawned new privsep daemon via rootwrap
Aug 17 16:21:42 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 16:21:42 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 16:21:42 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 17 16:21:42 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82086
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc376d81c-d4, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc376d81c-d4, col_values=(('external_ids', {'iface-id': 'c376d81c-d404-4f58-a623-8aa2b7181f0a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:e9:0b', 'vm-uuid': '6012ffd1-9d5e-48e3-8331-303109d68e0f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:43 user nova-compute[72724]: INFO os_vif [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4')
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:21:43 user nova-compute[72724]: INFO nova.compute.claims [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Claim successful on node user
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] No VIF found with MAC fa:16:3e:84:e9:0b, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:21:43 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:21:43 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Creating image(s)
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.policy [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8041c5cb8ad64f64b31aab70052e4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b9b4c4d963430e95e8b6fb484c9889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.214s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk 1073741824" returned: 0 in 0.049s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Successfully updated port: 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing instance network info cache due to event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Cannot resize image /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'migration_context' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Ensure instance console log exists: /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.network.neutron [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance network_info: |[{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.network.neutron [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Start _get_guest_xml network_info=[{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:21:45 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:45 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-582266070',display_name='tempest-ServerStableDeviceRescueTest-server-582266070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-582266070',id=2,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIj+ap/KOFchCg9v9kt6fYGpAv+Mvxn0PJW/oauRh73tKZWQAsQ4FM9ZriNj8mncH9E1li97b38WzbNB5Dm6dP7hywQlbsLzeTK9viM3b8J9CU24Q41zNAmpx3cVQXjJQ==',key_name='tempest-keypair-1867058309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e8428c63a474e2bb1d26c44c7a0e2c1',ramdisk_id='',reservation_id='r-m0z751gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-890446162',owner_user_name='tempest-ServerStableDeviceRescueTest-890446162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d21c9e7f6c3546fbaabef5fef9ba367e',uuid=bab1abaa-414c-4c50-ae78-be9126d9aafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converting VIF {"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.objects.instance [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'pci_devices' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:21:45 user nova-compute[72724]:   <uuid>bab1abaa-414c-4c50-ae78-be9126d9aafc</uuid>
Aug 17 16:21:45 user nova-compute[72724]:   <name>instance-00000002</name>
Aug 17 16:21:45 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:21:45 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:21:45 user nova-compute[72724]:   <metadata>
Aug 17 16:21:45 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:21:45 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:21:45 user nova-compute[72724]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-582266070</nova:name>
Aug 17 16:21:45 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:21:45</nova:creationTime>
Aug 17 16:21:45 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:21:45 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:21:45 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:21:45 user nova-compute[72724]:       <nova:owner>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:user uuid="d21c9e7f6c3546fbaabef5fef9ba367e">tempest-ServerStableDeviceRescueTest-890446162-project-member</nova:user>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:project uuid="0e8428c63a474e2bb1d26c44c7a0e2c1">tempest-ServerStableDeviceRescueTest-890446162</nova:project>
Aug 17 16:21:45 user nova-compute[72724]:       </nova:owner>
Aug 17 16:21:45 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:21:45 user nova-compute[72724]:       <nova:ports>
Aug 17 16:21:45 user nova-compute[72724]:         <nova:port uuid="7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d">
Aug 17 16:21:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 16:21:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:21:45 user nova-compute[72724]:       </nova:ports>
Aug 17 16:21:45 user nova-compute[72724]:     </nova:instance>
Aug 17 16:21:45 user nova-compute[72724]:   </metadata>
Aug 17 16:21:45 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:21:45 user nova-compute[72724]:     <system>
Aug 17 16:21:45 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:21:45 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:21:45 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:21:45 user nova-compute[72724]:       <entry name="serial">bab1abaa-414c-4c50-ae78-be9126d9aafc</entry>
Aug 17 16:21:45 user nova-compute[72724]:       <entry name="uuid">bab1abaa-414c-4c50-ae78-be9126d9aafc</entry>
Aug 17 16:21:45 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:21:45 user nova-compute[72724]:     </system>
Aug 17 16:21:45 user nova-compute[72724]:   </sysinfo>
Aug 17 16:21:45 user nova-compute[72724]:   <os>
Aug 17 16:21:45 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:21:45 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:21:45 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:21:45 user nova-compute[72724]:   </os>
Aug 17 16:21:45 user nova-compute[72724]:   <features>
Aug 17 16:21:45 user nova-compute[72724]:     <acpi/>
Aug 17 16:21:45 user nova-compute[72724]:     <apic/>
Aug 17 16:21:45 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:21:45 user nova-compute[72724]:   </features>
Aug 17 16:21:45 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:21:45 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:21:45 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:21:45 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:21:45 user nova-compute[72724]:   </clock>
Aug 17 16:21:45 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:21:45 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:21:45 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:21:45 user nova-compute[72724]:   </cpu>
Aug 17 16:21:45 user nova-compute[72724]:   <devices>
Aug 17 16:21:45 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:21:45 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:21:45 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk"/>
Aug 17 16:21:45 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:21:45 user nova-compute[72724]:     </disk>
Aug 17 16:21:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:21:45 user nova-compute[72724]:       <mac address="fa:16:3e:9b:aa:68"/>
Aug 17 16:21:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:21:45 user nova-compute[72724]:       <target dev="tap7d1dd947-fb"/>
Aug 17 16:21:45 user nova-compute[72724]:     </interface>
Aug 17 16:21:45 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:21:45 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/console.log" append="off"/>
Aug 17 16:21:45 user nova-compute[72724]:     </serial>
Aug 17 16:21:45 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:21:45 user nova-compute[72724]:     <video>
Aug 17 16:21:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:45 user nova-compute[72724]:     </video>
Aug 17 16:21:45 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:21:45 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:21:45 user nova-compute[72724]:     </rng>
Aug 17 16:21:45 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:21:45 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:21:45 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:21:45 user nova-compute[72724]:     </memballoon>
Aug 17 16:21:45 user nova-compute[72724]:   </devices>
Aug 17 16:21:45 user nova-compute[72724]: </domain>
Aug 17 16:21:45 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-582266070',display_name='tempest-ServerStableDeviceRescueTest-server-582266070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-582266070',id=2,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIj+ap/KOFchCg9v9kt6fYGpAv+Mvxn0PJW/oauRh73tKZWQAsQ4FM9ZriNj8mncH9E1li97b38WzbNB5Dm6dP7hywQlbsLzeTK9viM3b8J9CU24Q41zNAmpx3cVQXjJQ==',key_name='tempest-keypair-1867058309',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e8428c63a474e2bb1d26c44c7a0e2c1',ramdisk_id='',reservation_id='r-m0z751gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-890446162',owner_user_name='tempest-ServerStableDeviceRescueTest-890446162-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d21c9e7f6c3546fbaabef5fef9ba367e',uuid=bab1abaa-414c-4c50-ae78-be9126d9aafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converting VIF {"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG os_vif [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d1dd947-fb, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7d1dd947-fb, col_values=(('external_ids', {'iface-id': '7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:aa:68', 'vm-uuid': 'bab1abaa-414c-4c50-ae78-be9126d9aafc'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:45 user nova-compute[72724]: INFO os_vif [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb')
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:21:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No VIF found with MAC fa:16:3e:9b:aa:68, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updated VIF entry in instance network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e048db10-36a1-4f80-a661-4f8b50a7c9a6 req-73cac9d4-d1fd-4982-be46-839f8b71ac1c service nova] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289306.664513, 6012ffd1-9d5e-48e3-8331-303109d68e0f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:21:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] VM Resumed (Lifecycle Event)
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:21:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Instance spawned successfully.
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:21:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:21:46 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289306.672583, 6012ffd1-9d5e-48e3-8331-303109d68e0f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:21:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] VM Started (Lifecycle Event)
Aug 17 16:21:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:21:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:21:47 user nova-compute[72724]: INFO nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Took 13.78 seconds to spawn the instance on the hypervisor.
Aug 17 16:21:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:21:47 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:21:47 user nova-compute[72724]: INFO nova.compute.manager [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Took 14.73 seconds to build instance.
Aug 17 16:21:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1d6be8fa-0ac1-4cef-a720-b834a915a672 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.008s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:48 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Successfully created port: af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:21:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289309.77468, bab1abaa-414c-4c50-ae78-be9126d9aafc => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:21:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Resumed (Lifecycle Event)
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:21:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance spawned successfully.
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:21:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289309.7780132, bab1abaa-414c-4c50-ae78-be9126d9aafc => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:21:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Started (Lifecycle Event)
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:21:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:21:49 user nova-compute[72724]: INFO nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Took 11.33 seconds to spawn the instance on the hypervisor.
Aug 17 16:21:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:21:50 user nova-compute[72724]: INFO nova.compute.manager [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Took 12.11 seconds to build instance.
Aug 17 16:21:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-848c24fb-d6e8-4c8e-887d-ead7fa0ddc0c tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.262s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:21:51 user nova-compute[72724]: INFO nova.compute.claims [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Claim successful on node user
Aug 17 16:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:21:51 user nova-compute[72724]: DEBUG nova.network.neutron [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:21:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 17 16:21:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:21:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Creating image(s)
Aug 17 16:21:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "/opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "/opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "/opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "27ac1c41475c80b463c51b9ce3f83ea57d688f02" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "27ac1c41475c80b463c51b9ce3f83ea57d688f02" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.policy [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2fa2d03b77164cdf9d136a2fddc9ba44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a1035be40045c7a8cdfc6e32effd58', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Successfully updated port: af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing instance network info cache due to event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.part --force-share --output=json" returned: 0 in 0.251s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.virt.images [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] c5ee7428-b524-43e6-ad6d-2b4b3e81458f was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.part /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.part /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.converted" returned: 0 in 0.629s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02.converted --force-share --output=json" returned: 0 in 0.275s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "27ac1c41475c80b463c51b9ce3f83ea57d688f02" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.851s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 --force-share --output=json" returned: 0 in 0.239s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "27ac1c41475c80b463c51b9ce3f83ea57d688f02" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "27ac1c41475c80b463c51b9ce3f83ea57d688f02" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 --force-share --output=json" returned: 0 in 0.257s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02,backing_fmt=raw /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02,backing_fmt=raw /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk 1073741824" returned: 0 in 0.071s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "27ac1c41475c80b463c51b9ce3f83ea57d688f02" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Successfully created port: 08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-084fc82b-6017-4be9-ba2c-d42d7a31bf16 req-5702d445-a7e2-49d9-85da-e571f76ef82e service nova] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 --force-share --output=json" returned: 0 in 0.250s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:21:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Cannot resize image /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.objects.instance [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lazy-loading 'migration_context' on Instance uuid 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Ensure instance console log exists: /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance network_info: |[{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Start _get_guest_xml network_info=[{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:21:55 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:55 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:21:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-598960467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-598960467',id=3,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1S2U12q5XINVADtNiCYU+kxRLjdYC41oNeqB6/Ik3Y5bQlkgACwecUp9tCsemyfBWU7IEYLJGNQHWuk3ln03j/NicNbuIe/pUxMeSCvCGQEZBLy8KOEURrspLreUwl9Q==',key_name='tempest-keypair-513051232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-o12a1ie6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=254406ea-145e-40ff-8252-9e4a28db4892,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'pci_devices' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:21:56 user nova-compute[72724]:   <uuid>254406ea-145e-40ff-8252-9e4a28db4892</uuid>
Aug 17 16:21:56 user nova-compute[72724]:   <name>instance-00000003</name>
Aug 17 16:21:56 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:21:56 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:21:56 user nova-compute[72724]:   <metadata>
Aug 17 16:21:56 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:21:56 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:21:56 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-598960467</nova:name>
Aug 17 16:21:56 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:21:55</nova:creationTime>
Aug 17 16:21:56 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:21:56 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:21:56 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:21:56 user nova-compute[72724]:       <nova:owner>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:user uuid="8041c5cb8ad64f64b31aab70052e4f02">tempest-AttachVolumeShelveTestJSON-239110034-project-member</nova:user>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:project uuid="43b9b4c4d963430e95e8b6fb484c9889">tempest-AttachVolumeShelveTestJSON-239110034</nova:project>
Aug 17 16:21:56 user nova-compute[72724]:       </nova:owner>
Aug 17 16:21:56 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:21:56 user nova-compute[72724]:       <nova:ports>
Aug 17 16:21:56 user nova-compute[72724]:         <nova:port uuid="af4682ae-3a41-498e-a6b5-90e3492b5e80">
Aug 17 16:21:56 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 16:21:56 user nova-compute[72724]:         </nova:port>
Aug 17 16:21:56 user nova-compute[72724]:       </nova:ports>
Aug 17 16:21:56 user nova-compute[72724]:     </nova:instance>
Aug 17 16:21:56 user nova-compute[72724]:   </metadata>
Aug 17 16:21:56 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:21:56 user nova-compute[72724]:     <system>
Aug 17 16:21:56 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:21:56 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:21:56 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:21:56 user nova-compute[72724]:       <entry name="serial">254406ea-145e-40ff-8252-9e4a28db4892</entry>
Aug 17 16:21:56 user nova-compute[72724]:       <entry name="uuid">254406ea-145e-40ff-8252-9e4a28db4892</entry>
Aug 17 16:21:56 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:21:56 user nova-compute[72724]:     </system>
Aug 17 16:21:56 user nova-compute[72724]:   </sysinfo>
Aug 17 16:21:56 user nova-compute[72724]:   <os>
Aug 17 16:21:56 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:21:56 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:21:56 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:21:56 user nova-compute[72724]:   </os>
Aug 17 16:21:56 user nova-compute[72724]:   <features>
Aug 17 16:21:56 user nova-compute[72724]:     <acpi/>
Aug 17 16:21:56 user nova-compute[72724]:     <apic/>
Aug 17 16:21:56 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:21:56 user nova-compute[72724]:   </features>
Aug 17 16:21:56 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:21:56 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:21:56 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:21:56 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:21:56 user nova-compute[72724]:   </clock>
Aug 17 16:21:56 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:21:56 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:21:56 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:21:56 user nova-compute[72724]:   </cpu>
Aug 17 16:21:56 user nova-compute[72724]:   <devices>
Aug 17 16:21:56 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:21:56 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:21:56 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk"/>
Aug 17 16:21:56 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:21:56 user nova-compute[72724]:     </disk>
Aug 17 16:21:56 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:21:56 user nova-compute[72724]:       <mac address="fa:16:3e:9b:3b:75"/>
Aug 17 16:21:56 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:56 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:21:56 user nova-compute[72724]:       <target dev="tapaf4682ae-3a"/>
Aug 17 16:21:56 user nova-compute[72724]:     </interface>
Aug 17 16:21:56 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:21:56 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/console.log" append="off"/>
Aug 17 16:21:56 user nova-compute[72724]:     </serial>
Aug 17 16:21:56 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:21:56 user nova-compute[72724]:     <video>
Aug 17 16:21:56 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:56 user nova-compute[72724]:     </video>
Aug 17 16:21:56 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:21:56 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:21:56 user nova-compute[72724]:     </rng>
Aug 17 16:21:56 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:21:56 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:21:56 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:21:56 user nova-compute[72724]:     </memballoon>
Aug 17 16:21:56 user nova-compute[72724]:   </devices>
Aug 17 16:21:56 user nova-compute[72724]: </domain>
Aug 17 16:21:56 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-598960467',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-598960467',id=3,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1S2U12q5XINVADtNiCYU+kxRLjdYC41oNeqB6/Ik3Y5bQlkgACwecUp9tCsemyfBWU7IEYLJGNQHWuk3ln03j/NicNbuIe/pUxMeSCvCGQEZBLy8KOEURrspLreUwl9Q==',key_name='tempest-keypair-513051232',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-o12a1ie6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=254406ea-145e-40ff-8252-9e4a28db4892,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG os_vif [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf4682ae-3a, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf4682ae-3a, col_values=(('external_ids', {'iface-id': 'af4682ae-3a41-498e-a6b5-90e3492b5e80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:3b:75', 'vm-uuid': '254406ea-145e-40ff-8252-9e4a28db4892'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:56 user nova-compute[72724]: INFO os_vif [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a')
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No VIF found with MAC fa:16:3e:9b:3b:75, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Successfully updated port: 08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquired lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-changed-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Refreshing instance network info cache due to event network-changed-08c6bcd3-dc56-4857-8a19-7348c86f2cd8. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:21:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] Acquiring lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updating instance_info_cache with network_info: [{"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Releasing lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Instance network_info: |[{"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] Acquired lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.network.neutron [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Refreshing network info cache for port 08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Start _get_guest_xml network_info=[{"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:21:44Z,direct_url=<?>,disk_format='qcow2',id=c5ee7428-b524-43e6-ad6d-2b4b3e81458f,min_disk=0,min_ram=0,name='',owner='ab69380a74cb49a38564235a93d74806',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:21:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'scsi', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'c5ee7428-b524-43e6-ad6d-2b4b3e81458f'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:21:58 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:58 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:21:44Z,direct_url=<?>,disk_format='qcow2',id=c5ee7428-b524-43e6-ad6d-2b4b3e81458f,min_disk=0,min_ram=0,name='',owner='ab69380a74cb49a38564235a93d74806',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:21:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2060418484',display_name='tempest-AttachSCSIVolumeTestJSON-server-2060418484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2060418484',id=4,image_ref='c5ee7428-b524-43e6-ad6d-2b4b3e81458f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm05YtyapEdWqICWgLqPj+YNUDqM1QDulEqegl4NWb53GxVLuwh1ZOWzMP5rf2JJCW0u+gDt5ACf8oBLF3nwUz1/J3mai47QRST6I9MRIbnN+qu1WkofT2pQgYdj2sWfg==',key_name='tempest-keypair-1621869125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10a1035be40045c7a8cdfc6e32effd58',ramdisk_id='',reservation_id='r-1tnfbqp6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c5ee7428-b524-43e6-ad6d-2b4b3e81458f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-248490125',owner_user_name='tempest-AttachSCSIVolumeTestJSON-248490125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fa2d03b77164cdf9d136a2fddc9ba44',uuid=496b7bc3-5cfc-478b-b1f4-fbfd59426852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Converting VIF {"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.objects.instance [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lazy-loading 'pci_devices' on Instance uuid 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:21:58 user nova-compute[72724]:   <uuid>496b7bc3-5cfc-478b-b1f4-fbfd59426852</uuid>
Aug 17 16:21:58 user nova-compute[72724]:   <name>instance-00000004</name>
Aug 17 16:21:58 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:21:58 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:21:58 user nova-compute[72724]:   <metadata>
Aug 17 16:21:58 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:21:58 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:21:58 user nova-compute[72724]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-2060418484</nova:name>
Aug 17 16:21:58 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:21:58</nova:creationTime>
Aug 17 16:21:58 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:21:58 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:21:58 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:21:58 user nova-compute[72724]:       <nova:owner>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:user uuid="2fa2d03b77164cdf9d136a2fddc9ba44">tempest-AttachSCSIVolumeTestJSON-248490125-project-member</nova:user>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:project uuid="10a1035be40045c7a8cdfc6e32effd58">tempest-AttachSCSIVolumeTestJSON-248490125</nova:project>
Aug 17 16:21:58 user nova-compute[72724]:       </nova:owner>
Aug 17 16:21:58 user nova-compute[72724]:       <nova:root type="image" uuid="c5ee7428-b524-43e6-ad6d-2b4b3e81458f"/>
Aug 17 16:21:58 user nova-compute[72724]:       <nova:ports>
Aug 17 16:21:58 user nova-compute[72724]:         <nova:port uuid="08c6bcd3-dc56-4857-8a19-7348c86f2cd8">
Aug 17 16:21:58 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 16:21:58 user nova-compute[72724]:         </nova:port>
Aug 17 16:21:58 user nova-compute[72724]:       </nova:ports>
Aug 17 16:21:58 user nova-compute[72724]:     </nova:instance>
Aug 17 16:21:58 user nova-compute[72724]:   </metadata>
Aug 17 16:21:58 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:21:58 user nova-compute[72724]:     <system>
Aug 17 16:21:58 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:21:58 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:21:58 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:21:58 user nova-compute[72724]:       <entry name="serial">496b7bc3-5cfc-478b-b1f4-fbfd59426852</entry>
Aug 17 16:21:58 user nova-compute[72724]:       <entry name="uuid">496b7bc3-5cfc-478b-b1f4-fbfd59426852</entry>
Aug 17 16:21:58 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:21:58 user nova-compute[72724]:     </system>
Aug 17 16:21:58 user nova-compute[72724]:   </sysinfo>
Aug 17 16:21:58 user nova-compute[72724]:   <os>
Aug 17 16:21:58 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:21:58 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:21:58 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:21:58 user nova-compute[72724]:   </os>
Aug 17 16:21:58 user nova-compute[72724]:   <features>
Aug 17 16:21:58 user nova-compute[72724]:     <acpi/>
Aug 17 16:21:58 user nova-compute[72724]:     <apic/>
Aug 17 16:21:58 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:21:58 user nova-compute[72724]:   </features>
Aug 17 16:21:58 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:21:58 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:21:58 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:21:58 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:21:58 user nova-compute[72724]:   </clock>
Aug 17 16:21:58 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:21:58 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:21:58 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:21:58 user nova-compute[72724]:   </cpu>
Aug 17 16:21:58 user nova-compute[72724]:   <devices>
Aug 17 16:21:58 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:21:58 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:21:58 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk"/>
Aug 17 16:21:58 user nova-compute[72724]:       <target dev="sda" bus="scsi"/>
Aug 17 16:21:58 user nova-compute[72724]:       <address type="drive" controller="0" unit="0"/>
Aug 17 16:21:58 user nova-compute[72724]:     </disk>
Aug 17 16:21:58 user nova-compute[72724]:     <disk type="file" device="cdrom">
Aug 17 16:21:58 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 16:21:58 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.config"/>
Aug 17 16:21:58 user nova-compute[72724]:       <target dev="sdb" bus="scsi"/>
Aug 17 16:21:58 user nova-compute[72724]:       <address type="drive" controller="0" unit="1"/>
Aug 17 16:21:58 user nova-compute[72724]:     </disk>
Aug 17 16:21:58 user nova-compute[72724]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 17 16:21:58 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:21:58 user nova-compute[72724]:       <mac address="fa:16:3e:45:f0:74"/>
Aug 17 16:21:58 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:58 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:21:58 user nova-compute[72724]:       <target dev="tap08c6bcd3-dc"/>
Aug 17 16:21:58 user nova-compute[72724]:     </interface>
Aug 17 16:21:58 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:21:58 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/console.log" append="off"/>
Aug 17 16:21:58 user nova-compute[72724]:     </serial>
Aug 17 16:21:58 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:21:58 user nova-compute[72724]:     <video>
Aug 17 16:21:58 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:21:58 user nova-compute[72724]:     </video>
Aug 17 16:21:58 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:21:58 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:21:58 user nova-compute[72724]:     </rng>
Aug 17 16:21:58 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:21:58 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:21:58 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:21:58 user nova-compute[72724]:     </memballoon>
Aug 17 16:21:58 user nova-compute[72724]:   </devices>
Aug 17 16:21:58 user nova-compute[72724]: </domain>
Aug 17 16:21:58 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2060418484',display_name='tempest-AttachSCSIVolumeTestJSON-server-2060418484',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2060418484',id=4,image_ref='c5ee7428-b524-43e6-ad6d-2b4b3e81458f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm05YtyapEdWqICWgLqPj+YNUDqM1QDulEqegl4NWb53GxVLuwh1ZOWzMP5rf2JJCW0u+gDt5ACf8oBLF3nwUz1/J3mai47QRST6I9MRIbnN+qu1WkofT2pQgYdj2sWfg==',key_name='tempest-keypair-1621869125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='10a1035be40045c7a8cdfc6e32effd58',ramdisk_id='',reservation_id='r-1tnfbqp6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c5ee7428-b524-43e6-ad6d-2b4b3e81458f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-248490125',owner_user_name='tempest-AttachSCSIVolumeTestJSON-248490125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:21:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fa2d03b77164cdf9d136a2fddc9ba44',uuid=496b7bc3-5cfc-478b-b1f4-fbfd59426852,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Converting VIF {"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG os_vif [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08c6bcd3-dc, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08c6bcd3-dc, col_values=(('external_ids', {'iface-id': '08c6bcd3-dc56-4857-8a19-7348c86f2cd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:f0:74', 'vm-uuid': '496b7bc3-5cfc-478b-b1f4-fbfd59426852'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: INFO os_vif [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc')
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No BDM found with device name sda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No VIF found with MAC fa:16:3e:45:f0:74, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:21:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Using config drive
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:21:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Creating config drive at /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.config
Aug 17 16:21:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgnssqckj {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:21:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpgnssqckj" returned: 0 in 0.058s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:21:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updated VIF entry in instance network info cache for port 08c6bcd3-dc56-4857-8a19-7348c86f2cd8. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:21:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updating instance_info_cache with network_info: [{"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:21:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09f48d00-3563-49ad-831e-19930adcaa51 req-f9b3e59a-6042-4cd4-94d7-3c6231bd7565 service nova] Releasing lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-8eedcee9-1e17-40a4-a54b-1b96ae308ad3 req-1088def0-abb6-489c-affa-2e4bef252b2c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8eedcee9-1e17-40a4-a54b-1b96ae308ad3 req-1088def0-abb6-489c-affa-2e4bef252b2c service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8eedcee9-1e17-40a4-a54b-1b96ae308ad3 req-1088def0-abb6-489c-affa-2e4bef252b2c service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8eedcee9-1e17-40a4-a54b-1b96ae308ad3 req-1088def0-abb6-489c-affa-2e4bef252b2c service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-8eedcee9-1e17-40a4-a54b-1b96ae308ad3 req-1088def0-abb6-489c-affa-2e4bef252b2c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:00 user nova-compute[72724]: WARNING nova.compute.manager [req-8eedcee9-1e17-40a4-a54b-1b96ae308ad3 req-1088def0-abb6-489c-affa-2e4bef252b2c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state building and task_state spawning.
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289320.8175607, 254406ea-145e-40ff-8252-9e4a28db4892 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:00 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] VM Resumed (Lifecycle Event)
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:22:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance spawned successfully.
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:00 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289320.8182871, 254406ea-145e-40ff-8252-9e4a28db4892 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:00 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] VM Started (Lifecycle Event)
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:00 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:01 user nova-compute[72724]: INFO nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Took 17.21 seconds to spawn the instance on the hypervisor.
Aug 17 16:22:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:01 user nova-compute[72724]: INFO nova.compute.manager [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Took 18.01 seconds to build instance.
Aug 17 16:22:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9b0a10e4-4d54-4085-8af9-af212db08764 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.174s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:02 user nova-compute[72724]: WARNING nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state active and task_state None.
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] No waiting events found dispatching network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:02 user nova-compute[72724]: WARNING nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received unexpected event network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 for instance with vm_state building and task_state spawning.
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] No waiting events found dispatching network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:02 user nova-compute[72724]: WARNING nova.compute.manager [req-f60ddecd-fe00-47fb-b8dd-aa6ecb0d3cd2 req-bc399493-e780-4ee2-bd22-c5cdbac5bc41 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received unexpected event network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 for instance with vm_state building and task_state spawning.
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:22:02 user nova-compute[72724]: INFO nova.compute.claims [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Claim successful on node user
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.858s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.098s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:22:03 user nova-compute[72724]: INFO nova.compute.claims [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Claim successful on node user
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:22:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.policy [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '884bfb7eb9834776bf2229d859cb064a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1da4234e05d640a0810a70a4f5d00dc9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:22:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Creating image(s)
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "/opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "/opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.012s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289324.2167592, 496b7bc3-5cfc-478b-b1f4-fbfd59426852 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] VM Resumed (Lifecycle Event)
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Instance spawned successfully.
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.731s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.348s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289324.2178655, 496b7bc3-5cfc-478b-b1f4-fbfd59426852 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] VM Started (Lifecycle Event)
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Took 12.13 seconds to spawn the instance on the hypervisor.
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Took 13.49 seconds to build instance.
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.273s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.policy [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c77204386d84a2181e58358f1ade5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe523fb48904a97a8b02bbe415b6794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3907bf77-3ed0-434a-974a-1fbd87f3c5bc tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.730s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk 1073741824" returned: 0 in 0.101s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.379s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Successfully created port: c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:22:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Creating image(s)
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "/opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "/opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "/opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.033s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.279s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:22:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.249s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Cannot resize image /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lazy-loading 'migration_context' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Ensure instance console log exists: /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.242s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk 1073741824" returned: 0 in 0.077s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.322s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:22:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Successfully created port: a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.337s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Cannot resize image /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'migration_context' on Instance uuid 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Ensure instance console log exists: /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Successfully updated port: c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquired lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-changed-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Refreshing instance network info cache due to event network-changed-c6bf9a65-57d5-434e-9245-52872517116f. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] Acquiring lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updating instance_info_cache with network_info: [{"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Releasing lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Instance network_info: |[{"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] Acquired lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Refreshing network info cache for port c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Start _get_guest_xml network_info=[{"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:22:06 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:06 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-837723403',display_name='tempest-VolumesAssistedSnapshotsTest-server-837723403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-837723403',id=5,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX/Smn6Eb06SV5VjWvtec1/CVfKjRNEfpuKoLCsPZ703Pzw8YW/xOo0FGFCnq6JMyzIC/vYSVGlG5N4sg5cKsUQePLeyluoywjT74Uo5qsYlOhDtRX392oeCqX1LG92/A==',key_name='tempest-keypair-123596867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da4234e05d640a0810a70a4f5d00dc9',ramdisk_id='',reservation_id='r-ergd81d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1150961592',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1150961592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='884bfb7eb9834776bf2229d859cb064a',uuid=a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Converting VIF {"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.objects.instance [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lazy-loading 'pci_devices' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:22:06 user nova-compute[72724]:   <uuid>a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc</uuid>
Aug 17 16:22:06 user nova-compute[72724]:   <name>instance-00000005</name>
Aug 17 16:22:06 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:22:06 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:22:06 user nova-compute[72724]:   <metadata>
Aug 17 16:22:06 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:22:06 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:22:06 user nova-compute[72724]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-837723403</nova:name>
Aug 17 16:22:06 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:22:06</nova:creationTime>
Aug 17 16:22:06 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:22:06 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:22:06 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:22:06 user nova-compute[72724]:       <nova:owner>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:user uuid="884bfb7eb9834776bf2229d859cb064a">tempest-VolumesAssistedSnapshotsTest-1150961592-project-member</nova:user>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:project uuid="1da4234e05d640a0810a70a4f5d00dc9">tempest-VolumesAssistedSnapshotsTest-1150961592</nova:project>
Aug 17 16:22:06 user nova-compute[72724]:       </nova:owner>
Aug 17 16:22:06 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:22:06 user nova-compute[72724]:       <nova:ports>
Aug 17 16:22:06 user nova-compute[72724]:         <nova:port uuid="c6bf9a65-57d5-434e-9245-52872517116f">
Aug 17 16:22:06 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 16:22:06 user nova-compute[72724]:         </nova:port>
Aug 17 16:22:06 user nova-compute[72724]:       </nova:ports>
Aug 17 16:22:06 user nova-compute[72724]:     </nova:instance>
Aug 17 16:22:06 user nova-compute[72724]:   </metadata>
Aug 17 16:22:06 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:22:06 user nova-compute[72724]:     <system>
Aug 17 16:22:06 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:22:06 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:22:06 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:22:06 user nova-compute[72724]:       <entry name="serial">a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc</entry>
Aug 17 16:22:06 user nova-compute[72724]:       <entry name="uuid">a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc</entry>
Aug 17 16:22:06 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:22:06 user nova-compute[72724]:     </system>
Aug 17 16:22:06 user nova-compute[72724]:   </sysinfo>
Aug 17 16:22:06 user nova-compute[72724]:   <os>
Aug 17 16:22:06 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:22:06 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:22:06 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:22:06 user nova-compute[72724]:   </os>
Aug 17 16:22:06 user nova-compute[72724]:   <features>
Aug 17 16:22:06 user nova-compute[72724]:     <acpi/>
Aug 17 16:22:06 user nova-compute[72724]:     <apic/>
Aug 17 16:22:06 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:22:06 user nova-compute[72724]:   </features>
Aug 17 16:22:06 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:22:06 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:22:06 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:22:06 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:22:06 user nova-compute[72724]:   </clock>
Aug 17 16:22:06 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:22:06 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:22:06 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:22:06 user nova-compute[72724]:   </cpu>
Aug 17 16:22:06 user nova-compute[72724]:   <devices>
Aug 17 16:22:06 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:22:06 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:22:06 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk"/>
Aug 17 16:22:06 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:22:06 user nova-compute[72724]:     </disk>
Aug 17 16:22:06 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:22:06 user nova-compute[72724]:       <mac address="fa:16:3e:5e:91:c1"/>
Aug 17 16:22:06 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:22:06 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:22:06 user nova-compute[72724]:       <target dev="tapc6bf9a65-57"/>
Aug 17 16:22:06 user nova-compute[72724]:     </interface>
Aug 17 16:22:06 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:22:06 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/console.log" append="off"/>
Aug 17 16:22:06 user nova-compute[72724]:     </serial>
Aug 17 16:22:06 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:22:06 user nova-compute[72724]:     <video>
Aug 17 16:22:06 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:22:06 user nova-compute[72724]:     </video>
Aug 17 16:22:06 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:22:06 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:22:06 user nova-compute[72724]:     </rng>
Aug 17 16:22:06 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:22:06 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:22:06 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:22:06 user nova-compute[72724]:     </memballoon>
Aug 17 16:22:06 user nova-compute[72724]:   </devices>
Aug 17 16:22:06 user nova-compute[72724]: </domain>
Aug 17 16:22:06 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-837723403',display_name='tempest-VolumesAssistedSnapshotsTest-server-837723403',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-837723403',id=5,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX/Smn6Eb06SV5VjWvtec1/CVfKjRNEfpuKoLCsPZ703Pzw8YW/xOo0FGFCnq6JMyzIC/vYSVGlG5N4sg5cKsUQePLeyluoywjT74Uo5qsYlOhDtRX392oeCqX1LG92/A==',key_name='tempest-keypair-123596867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1da4234e05d640a0810a70a4f5d00dc9',ramdisk_id='',reservation_id='r-ergd81d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1150961592',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1150961592-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:22:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='884bfb7eb9834776bf2229d859cb064a',uuid=a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Converting VIF {"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG os_vif [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6bf9a65-57, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6bf9a65-57, col_values=(('external_ids', {'iface-id': 'c6bf9a65-57d5-434e-9245-52872517116f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:91:c1', 'vm-uuid': 'a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:07 user nova-compute[72724]: INFO os_vif [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57')
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] No VIF found with MAC fa:16:3e:5e:91:c1, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updated VIF entry in instance network info cache for port c6bf9a65-57d5-434e-9245-52872517116f. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updating instance_info_cache with network_info: [{"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8e6a1743-7ebb-467c-9d46-85f8005ea298 req-708fff7b-3ad2-4559-b75b-70a5f34683c9 service nova] Releasing lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Successfully updated port: a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquired lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-changed-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Refreshing instance network info cache due to event network-changed-a8d94a49-1d51-4196-93c2-d171ae349cd5. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] Acquiring lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updating instance_info_cache with network_info: [{"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Releasing lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Instance network_info: |[{"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] Acquired lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Refreshing network info cache for port a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Start _get_guest_xml network_info=[{"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:22:08 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:08 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1506414030',display_name='tempest-VolumesAdminNegativeTest-server-1506414030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1506414030',id=6,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWeJY7ZsxSl6lh9TmMXNmgSW/l0e40QPwRwt2LT1uysF0L5+gU5srAejl0MT7GDukBxRKOQ3BsDRYVQ+tME8e7IFUA8eKefsezDWpIxospYHITGsbl57kQuQmaHkjG1Dw==',key_name='tempest-keypair-1500127610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe523fb48904a97a8b02bbe415b6794',ramdisk_id='',reservation_id='r-fc0x1o3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1491017065',owner_user_name='tempest-VolumesAdminNegativeTest-1491017065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c77204386d84a2181e58358f1ade5a2',uuid=75fd7469-8155-43cf-a93c-fac4132c8f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converting VIF {"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'pci_devices' on Instance uuid 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:22:08 user nova-compute[72724]:   <uuid>75fd7469-8155-43cf-a93c-fac4132c8f03</uuid>
Aug 17 16:22:08 user nova-compute[72724]:   <name>instance-00000006</name>
Aug 17 16:22:08 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:22:08 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:22:08 user nova-compute[72724]:   <metadata>
Aug 17 16:22:08 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:22:08 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:22:08 user nova-compute[72724]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1506414030</nova:name>
Aug 17 16:22:08 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:22:08</nova:creationTime>
Aug 17 16:22:08 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:22:08 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:22:08 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:22:08 user nova-compute[72724]:       <nova:owner>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:user uuid="6c77204386d84a2181e58358f1ade5a2">tempest-VolumesAdminNegativeTest-1491017065-project-member</nova:user>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:project uuid="dbe523fb48904a97a8b02bbe415b6794">tempest-VolumesAdminNegativeTest-1491017065</nova:project>
Aug 17 16:22:08 user nova-compute[72724]:       </nova:owner>
Aug 17 16:22:08 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:22:08 user nova-compute[72724]:       <nova:ports>
Aug 17 16:22:08 user nova-compute[72724]:         <nova:port uuid="a8d94a49-1d51-4196-93c2-d171ae349cd5">
Aug 17 16:22:08 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 16:22:08 user nova-compute[72724]:         </nova:port>
Aug 17 16:22:08 user nova-compute[72724]:       </nova:ports>
Aug 17 16:22:08 user nova-compute[72724]:     </nova:instance>
Aug 17 16:22:08 user nova-compute[72724]:   </metadata>
Aug 17 16:22:08 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:22:08 user nova-compute[72724]:     <system>
Aug 17 16:22:08 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:22:08 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:22:08 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:22:08 user nova-compute[72724]:       <entry name="serial">75fd7469-8155-43cf-a93c-fac4132c8f03</entry>
Aug 17 16:22:08 user nova-compute[72724]:       <entry name="uuid">75fd7469-8155-43cf-a93c-fac4132c8f03</entry>
Aug 17 16:22:08 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:22:08 user nova-compute[72724]:     </system>
Aug 17 16:22:08 user nova-compute[72724]:   </sysinfo>
Aug 17 16:22:08 user nova-compute[72724]:   <os>
Aug 17 16:22:08 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:22:08 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:22:08 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:22:08 user nova-compute[72724]:   </os>
Aug 17 16:22:08 user nova-compute[72724]:   <features>
Aug 17 16:22:08 user nova-compute[72724]:     <acpi/>
Aug 17 16:22:08 user nova-compute[72724]:     <apic/>
Aug 17 16:22:08 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:22:08 user nova-compute[72724]:   </features>
Aug 17 16:22:08 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:22:08 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:22:08 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:22:08 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:22:08 user nova-compute[72724]:   </clock>
Aug 17 16:22:08 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:22:08 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:22:08 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:22:08 user nova-compute[72724]:   </cpu>
Aug 17 16:22:08 user nova-compute[72724]:   <devices>
Aug 17 16:22:08 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:22:08 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:22:08 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk"/>
Aug 17 16:22:08 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:22:08 user nova-compute[72724]:     </disk>
Aug 17 16:22:08 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:22:08 user nova-compute[72724]:       <mac address="fa:16:3e:cc:9e:06"/>
Aug 17 16:22:08 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:22:08 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:22:08 user nova-compute[72724]:       <target dev="tapa8d94a49-1d"/>
Aug 17 16:22:08 user nova-compute[72724]:     </interface>
Aug 17 16:22:08 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:22:08 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/console.log" append="off"/>
Aug 17 16:22:08 user nova-compute[72724]:     </serial>
Aug 17 16:22:08 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:22:08 user nova-compute[72724]:     <video>
Aug 17 16:22:08 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:22:08 user nova-compute[72724]:     </video>
Aug 17 16:22:08 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:22:08 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:22:08 user nova-compute[72724]:     </rng>
Aug 17 16:22:08 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:22:08 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:22:08 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:22:08 user nova-compute[72724]:     </memballoon>
Aug 17 16:22:08 user nova-compute[72724]:   </devices>
Aug 17 16:22:08 user nova-compute[72724]: </domain>
Aug 17 16:22:08 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1506414030',display_name='tempest-VolumesAdminNegativeTest-server-1506414030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1506414030',id=6,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWeJY7ZsxSl6lh9TmMXNmgSW/l0e40QPwRwt2LT1uysF0L5+gU5srAejl0MT7GDukBxRKOQ3BsDRYVQ+tME8e7IFUA8eKefsezDWpIxospYHITGsbl57kQuQmaHkjG1Dw==',key_name='tempest-keypair-1500127610',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe523fb48904a97a8b02bbe415b6794',ramdisk_id='',reservation_id='r-fc0x1o3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1491017065',owner_user_name='tempest-VolumesAdminNegativeTest-1491017065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c77204386d84a2181e58358f1ade5a2',uuid=75fd7469-8155-43cf-a93c-fac4132c8f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converting VIF {"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG os_vif [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8d94a49-1d, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa8d94a49-1d, col_values=(('external_ids', {'iface-id': 'a8d94a49-1d51-4196-93c2-d171ae349cd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:9e:06', 'vm-uuid': '75fd7469-8155-43cf-a93c-fac4132c8f03'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: INFO os_vif [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d')
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No VIF found with MAC fa:16:3e:cc:9e:06, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updated VIF entry in instance network info cache for port a8d94a49-1d51-4196-93c2-d171ae349cd5. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updating instance_info_cache with network_info: [{"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a083a7c-d141-4902-80bd-e9a6348fefaf req-6a2512e7-b5b7-42a2-8ecd-3951ba9893da service nova] Releasing lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] No waiting events found dispatching network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:09 user nova-compute[72724]: WARNING nova.compute.manager [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received unexpected event network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f for instance with vm_state building and task_state spawning.
Aug 17 16:22:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] No waiting events found dispatching network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:09 user nova-compute[72724]: WARNING nova.compute.manager [req-14383280-3330-4662-b6f7-0c435dec7437 req-87134bab-e555-4e25-bd7d-f82dda422b2d service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received unexpected event network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f for instance with vm_state building and task_state spawning.
Aug 17 16:22:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-7293a958-94c5-4747-86e1-dd3059a63128 req-d8d2e8f2-c40b-45ce-a223-9da3ae357880 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7293a958-94c5-4747-86e1-dd3059a63128 req-d8d2e8f2-c40b-45ce-a223-9da3ae357880 service nova] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7293a958-94c5-4747-86e1-dd3059a63128 req-d8d2e8f2-c40b-45ce-a223-9da3ae357880 service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7293a958-94c5-4747-86e1-dd3059a63128 req-d8d2e8f2-c40b-45ce-a223-9da3ae357880 service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-7293a958-94c5-4747-86e1-dd3059a63128 req-d8d2e8f2-c40b-45ce-a223-9da3ae357880 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] No waiting events found dispatching network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:11 user nova-compute[72724]: WARNING nova.compute.manager [req-7293a958-94c5-4747-86e1-dd3059a63128 req-d8d2e8f2-c40b-45ce-a223-9da3ae357880 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received unexpected event network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a for instance with vm_state active and task_state None.
Aug 17 16:22:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.claims [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Claim successful on node user
Aug 17 16:22:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289333.447217, a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] VM Resumed (Lifecycle Event)
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Instance spawned successfully.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289333.447532, a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] VM Started (Lifecycle Event)
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] No waiting events found dispatching network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:13 user nova-compute[72724]: WARNING nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received unexpected event network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a for instance with vm_state active and task_state None.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:13 user nova-compute[72724]: WARNING nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state None.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:13 user nova-compute[72724]: WARNING nova.compute.manager [req-abaa70c7-65cc-4333-876c-2f44188e5ea9 req-7f93762c-1686-4241-a2b8-af267f5e55bd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state None.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Took 9.70 seconds to spawn the instance on the hypervisor.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Took 11.14 seconds to build instance.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-de7ff5b1-9527-40c2-9554-3bec74b7df7a tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.334s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.policy [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e1309addf494df99a5a660510c89a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423d90110e74cd5aef429873bd098ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289333.9510362, 75fd7469-8155-43cf-a93c-fac4132c8f03 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] VM Resumed (Lifecycle Event)
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:22:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Instance spawned successfully.
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:22:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Creating image(s)
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:14 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289333.951676, 75fd7469-8155-43cf-a93c-fac4132c8f03 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:14 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] VM Started (Lifecycle Event)
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:14 user nova-compute[72724]: INFO nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Took 9.30 seconds to spawn the instance on the hypervisor.
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:14 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.236s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:14 user nova-compute[72724]: INFO nova.compute.manager [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Took 10.91 seconds to build instance.
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1cbb7012-785e-4b1b-bb30-61a4a97e46cb tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.117s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk 1073741824" returned: 0 in 0.063s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.273s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Successfully created port: 5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.328s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:22:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Cannot resize image /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'migration_context' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Ensure instance console log exists: /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Successfully updated port: 5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquired lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-changed-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Refreshing instance network info cache due to event network-changed-5a7d507b-63c6-47b2-9e30-c37f05e03f1e. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] Acquiring lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Releasing lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Instance network_info: |[{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] Acquired lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Refreshing network info cache for port 5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Start _get_guest_xml network_info=[{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:22:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'pci_devices' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:22:16 user nova-compute[72724]:   <uuid>f3f221f6-da33-46ff-be72-aadc05e46d8a</uuid>
Aug 17 16:22:16 user nova-compute[72724]:   <name>instance-00000007</name>
Aug 17 16:22:16 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:22:16 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:22:16 user nova-compute[72724]:   <metadata>
Aug 17 16:22:16 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:22:16 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:22:16 user nova-compute[72724]:       <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:22:16 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:22:16</nova:creationTime>
Aug 17 16:22:16 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:22:16 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:22:16 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:22:16 user nova-compute[72724]:       <nova:owner>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:22:16 user nova-compute[72724]:       </nova:owner>
Aug 17 16:22:16 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:22:16 user nova-compute[72724]:       <nova:ports>
Aug 17 16:22:16 user nova-compute[72724]:         <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:22:16 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:22:16 user nova-compute[72724]:         </nova:port>
Aug 17 16:22:16 user nova-compute[72724]:       </nova:ports>
Aug 17 16:22:16 user nova-compute[72724]:     </nova:instance>
Aug 17 16:22:16 user nova-compute[72724]:   </metadata>
Aug 17 16:22:16 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:22:16 user nova-compute[72724]:     <system>
Aug 17 16:22:16 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:22:16 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:22:16 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:22:16 user nova-compute[72724]:       <entry name="serial">f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:22:16 user nova-compute[72724]:       <entry name="uuid">f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:22:16 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:22:16 user nova-compute[72724]:     </system>
Aug 17 16:22:16 user nova-compute[72724]:   </sysinfo>
Aug 17 16:22:16 user nova-compute[72724]:   <os>
Aug 17 16:22:16 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:22:16 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:22:16 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:22:16 user nova-compute[72724]:   </os>
Aug 17 16:22:16 user nova-compute[72724]:   <features>
Aug 17 16:22:16 user nova-compute[72724]:     <acpi/>
Aug 17 16:22:16 user nova-compute[72724]:     <apic/>
Aug 17 16:22:16 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:22:16 user nova-compute[72724]:   </features>
Aug 17 16:22:16 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:22:16 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:22:16 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:22:16 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:22:16 user nova-compute[72724]:   </clock>
Aug 17 16:22:16 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:22:16 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:22:16 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:22:16 user nova-compute[72724]:   </cpu>
Aug 17 16:22:16 user nova-compute[72724]:   <devices>
Aug 17 16:22:16 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:22:16 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:22:16 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk"/>
Aug 17 16:22:16 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:22:16 user nova-compute[72724]:     </disk>
Aug 17 16:22:16 user nova-compute[72724]:     <disk type="file" device="cdrom">
Aug 17 16:22:16 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 16:22:16 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config"/>
Aug 17 16:22:16 user nova-compute[72724]:       <target dev="hda" bus="ide"/>
Aug 17 16:22:16 user nova-compute[72724]:     </disk>
Aug 17 16:22:16 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:22:16 user nova-compute[72724]:       <mac address="fa:16:3e:31:be:0a"/>
Aug 17 16:22:16 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:22:16 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:22:16 user nova-compute[72724]:       <target dev="tap5a7d507b-63"/>
Aug 17 16:22:16 user nova-compute[72724]:     </interface>
Aug 17 16:22:16 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:22:16 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log" append="off"/>
Aug 17 16:22:16 user nova-compute[72724]:     </serial>
Aug 17 16:22:16 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:22:16 user nova-compute[72724]:     <video>
Aug 17 16:22:16 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:22:16 user nova-compute[72724]:     </video>
Aug 17 16:22:16 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:22:16 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:22:16 user nova-compute[72724]:     </rng>
Aug 17 16:22:16 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:22:16 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:22:16 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:22:16 user nova-compute[72724]:     </memballoon>
Aug 17 16:22:16 user nova-compute[72724]:   </devices>
Aug 17 16:22:16 user nova-compute[72724]: </domain>
Aug 17 16:22:16 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG os_vif [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a7d507b-63, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5a7d507b-63, col_values=(('external_ids', {'iface-id': '5a7d507b-63c6-47b2-9e30-c37f05e03f1e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:be:0a', 'vm-uuid': 'f3f221f6-da33-46ff-be72-aadc05e46d8a'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:22:16 user nova-compute[72724]: INFO os_vif [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63')
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No BDM found with device name hda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:22:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No VIF found with MAC fa:16:3e:31:be:0a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:22:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Using config drive
Aug 17 16:22:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Creating config drive at /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config
Aug 17 16:22:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1mc92v6g {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1mc92v6g" returned: 0 in 0.063s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updated VIF entry in instance network info cache for port 5a7d507b-63c6-47b2-9e30-c37f05e03f1e. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:22:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-37b021f6-e264-4295-be56-e675c51b5206 req-9576a765-52d9-4bd7-8ad4-91731f865b20 service nova] Releasing lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289341.8874156, f3f221f6-da33-46ff-be72-aadc05e46d8a => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] VM Resumed (Lifecycle Event)
Aug 17 16:22:21 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Instance spawned successfully.
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:22:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289341.8879087, f3f221f6-da33-46ff-be72-aadc05e46d8a => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:22:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] VM Started (Lifecycle Event)
Aug 17 16:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:22:22 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:22:22 user nova-compute[72724]: INFO nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Took 8.07 seconds to spawn the instance on the hypervisor.
Aug 17 16:22:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:22:22 user nova-compute[72724]: INFO nova.compute.manager [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Took 9.00 seconds to build instance.
Aug 17 16:22:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9f1734ae-ae6b-48ed-913b-4bef394da5bd tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.193s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-17a115c4-fa1b-4311-b8c8-9c5c462ead59 req-63c20693-5863-4d09-ab1d-98eb51228a23 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17a115c4-fa1b-4311-b8c8-9c5c462ead59 req-63c20693-5863-4d09-ab1d-98eb51228a23 service nova] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17a115c4-fa1b-4311-b8c8-9c5c462ead59 req-63c20693-5863-4d09-ab1d-98eb51228a23 service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17a115c4-fa1b-4311-b8c8-9c5c462ead59 req-63c20693-5863-4d09-ab1d-98eb51228a23 service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-17a115c4-fa1b-4311-b8c8-9c5c462ead59 req-63c20693-5863-4d09-ab1d-98eb51228a23 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] No waiting events found dispatching network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:23 user nova-compute[72724]: WARNING nova.compute.manager [req-17a115c4-fa1b-4311-b8c8-9c5c462ead59 req-63c20693-5863-4d09-ab1d-98eb51228a23 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received unexpected event network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 for instance with vm_state active and task_state None.
Aug 17 16:22:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] No waiting events found dispatching network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:25 user nova-compute[72724]: WARNING nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received unexpected event network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 for instance with vm_state active and task_state None.
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:25 user nova-compute[72724]: WARNING nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e for instance with vm_state active and task_state None.
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:22:25 user nova-compute[72724]: WARNING nova.compute.manager [req-4314175d-741b-4309-82e2-306aae4fc00d req-a4f8ce97-27e2-4684-a5f7-1bcccd2a9705 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e for instance with vm_state active and task_state None.
Aug 17 16:22:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:22:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 6012ffd1-9d5e-48e3-8331-303109d68e0f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updating instance_info_cache with network_info: [{"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-6012ffd1-9d5e-48e3-8331-303109d68e0f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:22:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:22:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:22:33 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:33 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7553MB free_disk=25.972408294677734GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6012ffd1-9d5e-48e3-8331-303109d68e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 254406ea-145e-40ff-8252-9e4a28db4892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 75fd7469-8155-43cf-a93c-fac4132c8f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f3f221f6-da33-46ff-be72-aadc05e46d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:22:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:22:34 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:22:34 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:22:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:22:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.020s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:22:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:22:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:23:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:23:00 user nova-compute[72724]: INFO nova.compute.claims [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Claim successful on node user
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.712s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:23:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:01 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:23:01 user nova-compute[72724]: INFO nova.virt.block_device [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Booting with volume 0b44bdbc-6571-4ff5-afa5-c50cd17f2491 at /dev/vda
Aug 17 16:23:01 user nova-compute[72724]: DEBUG os_brick.utils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:01 user nova-compute[72724]: INFO oslo.privsep.daemon [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp1u5rbog8/privsep.sock']
Aug 17 16:23:01 user sudo[83730]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp1u5rbog8/privsep.sock
Aug 17 16:23:01 user sudo[83730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 17 16:23:01 user nova-compute[72724]: DEBUG nova.policy [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fd8a7c85787642d29b8d04b579fa92ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa128727c09e41048060f71bbd08239b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:23:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully created port: 758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully created port: b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:03 user sudo[83730]: pam_unix(sudo:session): session closed for user root
Aug 17 16:23:03 user nova-compute[72724]: INFO oslo.privsep.daemon [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Spawned new privsep daemon via rootwrap
Aug 17 16:23:03 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 17 16:23:03 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 17 16:23:03 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 17 16:23:03 user nova-compute[72724]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83733
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[47760f60-0690-4c37-99a0-796f53b80920]: (2,) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1db061-08c8-4c60-9aa5-6db20cdf28d7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.nvmeof [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3fd067-b8b1-4371-848a-75517784c325]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c5b42-1bc0-4ca0-8aa5-8f9dbae4bb10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3fb2b6-ced0-4ec7-b397-bb513040ecd3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:03 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69836d7-2af1-4fa6-8c08-e6b4efad56b8]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG os_brick.utils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== get_connector_properties: return (2132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:03 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating existing volume attachment record: 42d3ce55-bcac-4857-80df-67e53641c601 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully created port: 8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully created port: 90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:05 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully created port: a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: 758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-758b2d53-09eb-4c58-a714-ed93860689d1. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port 758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4db43d63-ed16-4c86-a6f5-f7e82ea9f71d req-59220546-0956-4d6d-9921-e9c393f152cb service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: 18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-a777c43d-59bc-4d73-b99c-69791dc7938b. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-18020b51-b71d-4705-b14d-e53a385e5599. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port 18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e0eb13c0-6801-48fb-8770-bfd2f9421e8c req-69091d36-f88d-4f58-9a77-36e146552142 service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: 8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: 90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-b3fac642-9cee-4d26-b66f-3d939b1e8ce9. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-8ddfde5f-c528-4dd4-962e-befe7adff8cd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port 8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2327c985-4162-4517-bbd7-b94640ffa88a req-c430613f-b763-4218-9cba-482fee40f08f service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Successfully updated port: a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:23:11 user nova-compute[72724]: INFO nova.compute.claims [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Claim successful on node user
Aug 17 16:23:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:23:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:23:12 user nova-compute[72724]: INFO nova.virt.block_device [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Booting with volume a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 at /dev/vda
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.policy [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5cd148f811734a8db6c8658ecc00caf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5dbe91ac114e41c3b78db18dbf445d00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG os_brick.utils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e32b5b7-d6bf-4c35-96a1-7dc7753c74f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f06465-1d25-4d01-8c3d-d0253995e4ca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb156e6-8b32-4022-ba25-69e0130fe741]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b66e73-ddb1-4a26-bc66-3e846c82ed6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:12 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[617b7cbc-e89c-4e9a-b150-d63f624c9787]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG os_brick.utils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating existing volume attachment record: 8d90751e-de20-48b6-8ac7-165de8bcf60f {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-90c074dd-d736-458b-932a-f0383adcce60. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully created port: 30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully created port: 81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance network_info: |[{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port 90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updated VIF entry in instance network info cache for port 90c074dd-d736-458b-932a-f0383adcce60. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-a0cef184-4efb-44e9-b54e-def6b34d364d. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully created port: 41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updated VIF entry in instance network info cache for port a0cef184-4efb-44e9-b54e-def6b34d364d. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5b7a5857-82c8-44a3-ac08-529f9b82351e req-9d1ca7c7-2782-446b-a8e2-3dc48a810964 service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully created port: ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:15 user nova-compute[72724]: INFO nova.virt.block_device [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Booting with volume 82f51d00-f47f-4c69-b95d-3cf2d5d55119 at /dev/vdb
Aug 17 16:23:15 user nova-compute[72724]: DEBUG os_brick.utils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff79cb6-f68a-4ad4-a174-21e621adfbd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b78c74-eba8-4248-b0d1-0a4db9434a1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3cb6b4-68b5-4646-b523-51c09d2175c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbbdd12-11b2-4f6a-a241-68786e678f82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:15 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cdc7d7-ceb4-4339-84b8-b653b5d91645]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG os_brick.utils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:15 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating existing volume attachment record: 7057b0ee-52b4-4aac-a875-e515c520b4b4 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully created port: d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:23:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: 30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-30053a0b-9af1-4a83-b2fb-aeef68758317. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port 30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac3da471-c554-47b9-9fbc-0aa3bb21a3d2 req-8f88ef89-6108-44df-80e1-08c658a20866 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-c9d0e07d-2f62-4841-b85e-264704ad8a36. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: 35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1147303e-060d-4df3-9c09-87ff79f2a1f1 req-6e64c57a-f5da-430b-a99d-4a5f99bab562 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: 81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-35d9f38e-21cb-4b84-9ca1-70bf70001b23. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port 35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: 41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port 81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c93d640-a8c5-4499-b35f-dbe8da60b9c5 req-f8780c27-b52c-4893-b055-74bf42774690 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Successfully updated port: d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:23:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:23:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:23:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:24 user nova-compute[72724]: INFO nova.virt.block_device [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Booting with volume 039bd2db-7ceb-401c-a10b-4cd8bcfcd97b at /dev/vdb
Aug 17 16:23:24 user nova-compute[72724]: DEBUG os_brick.utils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1758d111-1186-4e11-9136-88aca6c724e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8c3d7c-ded3-4b22-8ecb-bce4da064345]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ebcc28-3317-4d57-b631-3fa0983cc025]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e51d59b-d5ef-4365-90d4-f016ef89e427]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:24 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa0725-a49a-4f41-918d-65356dbb6b5d]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG os_brick.utils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:24 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating existing volume attachment record: 0f66cc01-a7e9-440e-bcdf-53ecd555c339 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance network_info: |[{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port 41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updated VIF entry in instance network info cache for port 41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-ae01c189-8507-462e-9590-fd829544bd96. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:25 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updated VIF entry in instance network info cache for port ae01c189-8507-462e-9590-fd829544bd96. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-d780aa98-e043-4055-8af9-1f52567806c5. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lazy-loading 'flavor' on Instance uuid 6012ffd1-9d5e-48e3-8331-303109d68e0f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updated VIF entry in instance network info cache for port d780aa98-e043-4055-8af9-1f52567806c5. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09c08a67-9b95-43d7-ab03-5df6951050ad req-71b8944a-0e98-4dd3-ac54-bbb567920582 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:26 user nova-compute[72724]: INFO nova.compute.manager [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Attaching volume d78a38b2-ef80-4977-8f72-4f8384404691 to /dev/vdb
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4e451c-2d7e-42dd-a8f2-51816986f75c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e233ee-a991-4472-8d79-bddb0184eb2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8bd6f7-f429-41d4-9baf-2ce04418203e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac4b154-a84d-4674-adaa-025031ee7676]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:27 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66233594-ba2e-4a4b-bd95-ce77f1aed747]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updating existing volume attachment record: 30ed719d-7bb0-4510-8410-26ea0011ca86 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:27 user nova-compute[72724]: INFO nova.virt.block_device [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Booting with volume 899b34a2-503c-4785-b42c-edf92beefc26 at /dev/vdc
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bed7ba-ac0c-45a7-aeec-53b3a732690e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7063f087-985e-4039-8e7c-efcee41dc48a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebcf4a-e6aa-43ef-953e-53403ccdc875]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba62beba-93f7-466b-af98-5a7b6197821e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:27 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1745f7d9-2fdf-4b9c-8e93-3c2196508b72]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:27 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating existing volume attachment record: 83c4a21a-266b-4d4f-87b3-bf505ab48f59 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing instance network info cache due to event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG nova.network.neutron [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:23:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.network.neutron [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updated VIF entry in instance network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.network.neutron [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ded341d9-12b4-4687-a884-cf4d0b4d2722 req-ca403649-08a9-4ec0-95c2-bde589976924 service nova] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:30 user nova-compute[72724]: INFO nova.compute.manager [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] instance snapshotting
Aug 17 16:23:30 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Beginning live snapshot process
Aug 17 16:23:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json -f qcow2" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqk_689x2/09d6b7d4641e4083a380ed688d38ff71.delta 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqk_689x2/09d6b7d4641e4083a380ed688d38ff71.delta 1073741824" returned: 0 in 0.050s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 16:23:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72724) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 17 16:23:31 user nova-compute[72724]: INFO nova.virt.libvirt.host [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] UEFI support detected
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:23:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 16:23:32 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqk_689x2/09d6b7d4641e4083a380ed688d38ff71.delta /opt/stack/data/nova/instances/snapshots/tmpqk_689x2/09d6b7d4641e4083a380ed688d38ff71 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqk_689x2/09d6b7d4641e4083a380ed688d38ff71.delta /opt/stack/data/nova/instances/snapshots/tmpqk_689x2/09d6b7d4641e4083a380ed688d38ff71" returned: 0 in 0.571s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Snapshot extracted, beginning image upload
Aug 17 16:23:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing instance network info cache due to event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.network.neutron [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:23:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7578MB free_disk=25.8739013671875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6012ffd1-9d5e-48e3-8331-303109d68e0f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 254406ea-145e-40ff-8252-9e4a28db4892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 75fd7469-8155-43cf-a93c-fac4132c8f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f3f221f6-da33-46ff-be72-aadc05e46d8a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance de3f1276-aa06-4843-a69a-165a7c624f8f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.503s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.network.neutron [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updated VIF entry in instance network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG nova.network.neutron [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-60d0f703-1ba5-4028-8296-c8c0eaf85a00 req-fe23da7e-1085-4e5d-aa1c-6344046f6af5 service nova] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Snapshot image upload complete
Aug 17 16:23:36 user nova-compute[72724]: INFO nova.compute.manager [None req-58a781ab-05f6-4bca-ac0d-38f9a969833f tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Took 5.94 seconds to snapshot the instance on the hypervisor.
Aug 17 16:23:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:37 user nova-compute[72724]: INFO nova.virt.block_device [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Booting with volume 1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 at /dev/vdc
Aug 17 16:23:37 user nova-compute[72724]: DEBUG os_brick.utils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[77934c60-ad62-4796-bc8a-3a761d328ac6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbee468b-bb29-4d3f-965d-97190906a456]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c06b42-73e9-4f1a-8c63-b70b9aa61ca6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdaf2591-6c4d-4aaf-a402-6f8d827bb844]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:37 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9db11a-8874-42ae-aea4-993128df7384]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG os_brick.utils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:37 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating existing volume attachment record: cde78bbf-2eda-4003-9ce0-a74a672e5406 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connector [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Factory for ISCSI on None {{(pid=72724) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOkWshtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:39 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:39 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:39 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[79ffc713-cc96-4017-b65b-90bbb10e2373]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:39 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa37c69-2b64-41c3-bb13-5844915d6659]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691] added
Aug 17 16:23:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8919db0-8ed7-491b-aa1c-4c6fd28f1fa0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f37086-d349-4256-9762-33a9bc681203]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOkWshtS {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HOkWshtS" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cee0e8-e112-4426-a3ab-9875ba0aae16]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HOkWshtS'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eea77d1-526d-41e5-9e7a-3e85f45d59d2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[083027be-5e23-48ef-85aa-e25c7341316d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:23:39 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:23:39 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:39 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 16:23:39 user nova-compute[72724]: 
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2001af-1ceb-45e5-803e-ffe95abbf0b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260]
Aug 17 16:23:39 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[947be7b1-bba1-4f83-ae50-3c92892854bf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d356c0-78fc-4228-bd18-5f2c226d8cc7]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] HCTL ('33', '-', '-', 0) found on session 3 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f2b50d-692e-4b97-9aa4-d74e7f75e14f]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:23:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Creating image(s)
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Ensure instance console log exists: /opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Start _get_guest_xml network_info=[{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '42d3ce55-bcac-4857-80df-67e53641c601', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBshEPXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de3f1276-aa06-4843-a69a-165a7c624f8f', 'attached_at': '', 'detached_at': '', 'volume_id': '0b44bdbc-6571-4ff5-afa5-c50cd17f2491', 'serial': '0b44bdbc-6571-4ff5-afa5-c50cd17f2491'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '7057b0ee-52b4-4aac-a875-e515c520b4b4', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNLsGlQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de3f1276-aa06-4843-a69a-165a7c624f8f', 'attached_at': '', 'detached_at': '', 'volume_id': '82f51d00-f47f-4c69-b95d-3cf2d5d55119', 'serial': '82f51d00-f47f-4c69-b95d-3cf2d5d55119'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'attachment_id': '83c4a21a-266b-4d4f-87b3-bf505ab48f59', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItASTVqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'de3f1276-aa06-4843-a69a-165a7c624f8f', 'attached_at': '', 'detached_at': '', 'volume_id': '899b34a2-503c-4785-b42c-edf92beefc26', 'serial': '899b34a2-503c-4785-b42c-edf92beefc26'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:40 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:23:40 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBshEPXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:40 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Searching for a device in session 3 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOkWshtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26535613533633934', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535613533633934', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.168s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:40 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:40 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lazy-loading 'flavor' on Instance uuid 6012ffd1-9d5e-48e3-8331-303109d68e0f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d59845-1dd0-4f43-9b20-cb63e8e19c9c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:40 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:23:40 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:40 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:23:40 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:23:40 user nova-compute[72724]:   <serial>d78a38b2-ef80-4977-8f72-4f8384404691</serial>
Aug 17 16:23:40 user nova-compute[72724]: </disk>
Aug 17 16:23:40 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[001823a6-6eed-4a2a-9a78-71aa20df26b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491] added
Aug 17 16:23:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8170d1d-e6ef-4a80-a810-3bb4396caa67]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba018225-6126-48fc-b9c1-91eb89425f46]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBshEPXL {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBshEPXL" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbcce5e3-6b16-4830-9d75-1da5562a2381]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBshEPXL'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ba01a3-1e1b-43c3-ba87-71ecc5f3d9e4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77c4eaf-813d-4997-bf5b-9bdd83385786]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d2603d-b185-4687-a96c-f6fd44c31bef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260]
Aug 17 16:23:40 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc7b5f5a-ef89-48e0-a75c-61e35a56663c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1770dc4-964c-403b-bfc5-e5498728d493]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:41 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:41 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0927bfdc-9eb4-4650-a6c8-63810befae62]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBshEPXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] No VIF found with MAC fa:16:3e:84:e9:0b, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c7d85b94-6dc9-4315-8fb5-1423c4659df3 tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.490s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:41 user nova-compute[72724]: INFO nova.compute.manager [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Terminating instance
Aug 17 16:23:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== connect_volume: return (1490ms) {'type': 'block', 'scsi_wwn': '23138386563303866', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138386563303866', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNLsGlQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:42 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:42 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:42 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa9976-04a9-4cc8-8e7b-b2cf21d73e1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:42 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d50c991-20d2-4fb8-a957-f2a476ebab8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119] added
Aug 17 16:23:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6726e804-0218-4f6e-9abd-d151ae500969]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0287106e-4e36-4e84-b437-729f23224df1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNLsGlQv {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RNLsGlQv" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6aa663-0a75-41f0-89cd-27cb7c06190a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RNLsGlQv'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64a8d3-e695-4bde-92af-e69773daa66f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-changed-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Refreshing instance network info cache due to event network-changed-08c6bcd3-dc56-4857-8a19-7348c86f2cd8. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] Acquiring lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] Acquired lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.network.neutron [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Refreshing network info cache for port 08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[344ec891-71be-4a5c-a42f-d9444877b185]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d980a49b-ec5c-40aa-a081-f03cc8ffee87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260]
Aug 17 16:23:42 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-7b671ee6-82d8-4af4-9c84-0596446bb479 req-3562000f-8991-4bc5-aaba-d959659eedbe service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-vif-unplugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7b671ee6-82d8-4af4-9c84-0596446bb479 req-3562000f-8991-4bc5-aaba-d959659eedbe service nova] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7b671ee6-82d8-4af4-9c84-0596446bb479 req-3562000f-8991-4bc5-aaba-d959659eedbe service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7b671ee6-82d8-4af4-9c84-0596446bb479 req-3562000f-8991-4bc5-aaba-d959659eedbe service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-7b671ee6-82d8-4af4-9c84-0596446bb479 req-3562000f-8991-4bc5-aaba-d959659eedbe service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] No waiting events found dispatching network-vif-unplugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-7b671ee6-82d8-4af4-9c84-0596446bb479 req-3562000f-8991-4bc5-aaba-d959659eedbe service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-vif-unplugged-c376d81c-d404-4f58-a623-8aa2b7181f0a for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5884ea12-d9d5-4395-8c2f-7e88cfff5b8f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[80713c9c-04dc-44e0-a853-76eae92c8429]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cbadd9-28f9-4a4e-8b75-bc1a6c52c093]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNLsGlQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Instance destroyed successfully.
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.objects.instance [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lazy-loading 'resources' on Instance uuid 6012ffd1-9d5e-48e3-8331-303109d68e0f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-2072044573',display_name='tempest-DeleteServersTestJSON-server-2072044573',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-2072044573',id=1,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:21:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2281f26e94004b718a3b213565bb52cb',ramdisk_id='',reservation_id='r-xrg1ytll',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-982797275',owner_user_name='tempest-DeleteServersTestJSON-982797275-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:21:47Z,user_data=None,user_id='5984e05fc507464e9912f8666a0513ac',uuid=6012ffd1-9d5e-48e3-8331-303109d68e0f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Converting VIF {"id": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "address": "fa:16:3e:84:e9:0b", "network": {"id": "105762cc-d0fa-4e5a-ba47-e937c062a7e2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1902626878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2281f26e94004b718a3b213565bb52cb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc376d81c-d4", "ovs_interfaceid": "c376d81c-d404-4f58-a623-8aa2b7181f0a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_vif [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc376d81c-d4, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:42 user nova-compute[72724]: INFO os_vif [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:e9:0b,bridge_name='br-int',has_traffic_filtering=True,id=c376d81c-d404-4f58-a623-8aa2b7181f0a,network=Network(105762cc-d0fa-4e5a-ba47-e937c062a7e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc376d81c-d4')
Aug 17 16:23:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HOkWshtS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:42 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:43 user nova-compute[72724]: INFO nova.compute.manager [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Shelving
Aug 17 16:23:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '26161666461653431', 'path': '/dev/sdd'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161666461653431', 'path': '/dev/sdd'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.666s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[67417d1f-493b-48e7-a552-54c457151f26]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItASTVqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:43 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb5216-2f56-4bfa-bbfd-ff8c02fb1abd]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:43 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:43 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:43 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 (non-flash)
Aug 17 16:23:43 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:43 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:43 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e80a48b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06c45ce-b589-40f0-93b9-73a01193b039]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac63ff-1adb-4607-b308-aea8ce2656d2]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-b90672a3-b969-49f2-b362-0a95e8a13bbe req-42d5d6a7-3032-4ecc-96c8-57a2d879951a service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b90672a3-b969-49f2-b362-0a95e8a13bbe req-42d5d6a7-3032-4ecc-96c8-57a2d879951a service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b90672a3-b969-49f2-b362-0a95e8a13bbe req-42d5d6a7-3032-4ecc-96c8-57a2d879951a service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b90672a3-b969-49f2-b362-0a95e8a13bbe req-42d5d6a7-3032-4ecc-96c8-57a2d879951a service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-b90672a3-b969-49f2-b362-0a95e8a13bbe req-42d5d6a7-3032-4ecc-96c8-57a2d879951a service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:43 user nova-compute[72724]: WARNING nova.compute.manager [req-b90672a3-b969-49f2-b362-0a95e8a13bbe req-42d5d6a7-3032-4ecc-96c8-57a2d879951a service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state active and task_state shelving.
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f730ecf0-ba02-4e78-857d-f5c176ec905d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[723a0ad6-677f-4421-825f-b64b712c8782]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a48f48-c1b5-4a38-8f02-9aa608004be2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updated VIF entry in instance network info cache for port 08c6bcd3-dc56-4857-8a19-7348c86f2cd8. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updating instance_info_cache with network_info: [{"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e52375-c197-4c15-aaf2-7733921237fc]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260]
Aug 17 16:23:43 user nova-compute[72724]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:43 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a09f9ea-a973-40cc-920b-1407836ae384 req-25cbdc95-385f-4f4b-8e2b-af71b7f0bca1 service nova] Releasing lock "refresh_cache-496b7bc3-5cfc-478b-b1f4-fbfd59426852" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d78a38b2-ef80-4977-8f72-4f8384404691 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6690097b-0705-411b-adc0-00d9569b8143]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] <== disconnect_volume: return (985ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:23:43 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Deleting instance files /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f_del
Aug 17 16:23:43 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Deletion of /opt/stack/data/nova/instances/6012ffd1-9d5e-48e3-8331-303109d68e0f_del complete
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.295s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:43 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:43 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb70e5c-dcc7-431c-8eef-c61ca845cc98]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:43 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca9af20-9840-4a87-b297-051fe57459d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26] added
Aug 17 16:23:43 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: INFO nova.compute.manager [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Took 1.95 seconds to destroy the instance on the hypervisor.
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[801197d0-cff3-4140-95a9-28f7ede0fbe8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c535ee8d-c438-4814-9513-780f7bdf359c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItASTVqN {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ItASTVqN" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[434fc1eb-f9f5-41f4-a81e-93d752c32dc6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ItASTVqN'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[238c1457-642b-4f32-a52b-367fd2bc604b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:43 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec30147-474d-4d56-b0c7-430c4ef7f492]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:44 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance destroyed successfully.
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af93a7-a759-4273-a953-a310b7c6739f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260]
Aug 17 16:23:44 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:44 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Beginning cold snapshot process
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[153a7a0a-8d01-45a8-b7e5-eff72634a5e5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f8c5d1-eb6b-40d9-9f0d-c20ee029a9ba]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] HCTL ('33', '-', '-', 0) found on session 6 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b74b5-e176-4426-9599-377007a7e0aa]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Searching for a device in session 6 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItASTVqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk /opt/stack/data/nova/instances/snapshots/tmpvoeew9w1/4e6c1132ac314860a9f9e00564742112 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-f18000b4-912c-4f88-99b7-b9f5a3b83871 req-524aae73-35a7-42a9-994f-0217b958a920 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f18000b4-912c-4f88-99b7-b9f5a3b83871 req-524aae73-35a7-42a9-994f-0217b958a920 service nova] Acquiring lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f18000b4-912c-4f88-99b7-b9f5a3b83871 req-524aae73-35a7-42a9-994f-0217b958a920 service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f18000b4-912c-4f88-99b7-b9f5a3b83871 req-524aae73-35a7-42a9-994f-0217b958a920 service nova] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-f18000b4-912c-4f88-99b7-b9f5a3b83871 req-524aae73-35a7-42a9-994f-0217b958a920 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] No waiting events found dispatching network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:44 user nova-compute[72724]: WARNING nova.compute.manager [req-f18000b4-912c-4f88-99b7-b9f5a3b83871 req-524aae73-35a7-42a9-994f-0217b958a920 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received unexpected event network-vif-plugged-c376d81c-d404-4f58-a623-8aa2b7181f0a for instance with vm_state active and task_state deleting.
Aug 17 16:23:44 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:44 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Took 0.73 seconds to deallocate network for instance.
Aug 17 16:23:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk /opt/stack/data/nova/instances/snapshots/tmpvoeew9w1/4e6c1132ac314860a9f9e00564742112" returned: 0 in 0.630s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:44 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Snapshot extracted, beginning image upload
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== connect_volume: return (1646ms) {'type': 'block', 'scsi_wwn': '26665346130323238', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665346130323238', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lazy-loading 'pci_devices' on Instance uuid de3f1276-aa06-4843-a69a-165a7c624f8f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:23:45 user nova-compute[72724]:   <uuid>de3f1276-aa06-4843-a69a-165a7c624f8f</uuid>
Aug 17 16:23:45 user nova-compute[72724]:   <name>instance-00000008</name>
Aug 17 16:23:45 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:23:45 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:23:45 user nova-compute[72724]:   <metadata>
Aug 17 16:23:45 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:23:45 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:23:45 user nova-compute[72724]:       <nova:name>tempest-device-tagging-server-1309932517</nova:name>
Aug 17 16:23:45 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:23:40</nova:creationTime>
Aug 17 16:23:45 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:23:45 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:23:45 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:23:45 user nova-compute[72724]:       <nova:owner>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:user uuid="fd8a7c85787642d29b8d04b579fa92ad">tempest-TaggedBootDevicesTest-1054668907-project-member</nova:user>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:project uuid="aa128727c09e41048060f71bbd08239b">tempest-TaggedBootDevicesTest-1054668907</nova:project>
Aug 17 16:23:45 user nova-compute[72724]:       </nova:owner>
Aug 17 16:23:45 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:23:45 user nova-compute[72724]:       <nova:ports>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="758b2d53-09eb-4c58-a714-ed93860689d1">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="a777c43d-59bc-4d73-b99c-69791dc7938b">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="18020b51-b71d-4705-b14d-e53a385e5599">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.219" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="b3fac642-9cee-4d26-b66f-3d939b1e8ce9">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.135" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="8ddfde5f-c528-4dd4-962e-befe7adff8cd">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.225" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="90c074dd-d736-458b-932a-f0383adcce60">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:         <nova:port uuid="a0cef184-4efb-44e9-b54e-def6b34d364d">
Aug 17 16:23:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 16:23:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:45 user nova-compute[72724]:       </nova:ports>
Aug 17 16:23:45 user nova-compute[72724]:     </nova:instance>
Aug 17 16:23:45 user nova-compute[72724]:   </metadata>
Aug 17 16:23:45 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:23:45 user nova-compute[72724]:     <system>
Aug 17 16:23:45 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:23:45 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:23:45 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:23:45 user nova-compute[72724]:       <entry name="serial">de3f1276-aa06-4843-a69a-165a7c624f8f</entry>
Aug 17 16:23:45 user nova-compute[72724]:       <entry name="uuid">de3f1276-aa06-4843-a69a-165a7c624f8f</entry>
Aug 17 16:23:45 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:23:45 user nova-compute[72724]:     </system>
Aug 17 16:23:45 user nova-compute[72724]:   </sysinfo>
Aug 17 16:23:45 user nova-compute[72724]:   <os>
Aug 17 16:23:45 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:23:45 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:23:45 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:23:45 user nova-compute[72724]:   </os>
Aug 17 16:23:45 user nova-compute[72724]:   <features>
Aug 17 16:23:45 user nova-compute[72724]:     <acpi/>
Aug 17 16:23:45 user nova-compute[72724]:     <apic/>
Aug 17 16:23:45 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:23:45 user nova-compute[72724]:   </features>
Aug 17 16:23:45 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:23:45 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:23:45 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:23:45 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:23:45 user nova-compute[72724]:   </clock>
Aug 17 16:23:45 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:23:45 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:23:45 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:23:45 user nova-compute[72724]:   </cpu>
Aug 17 16:23:45 user nova-compute[72724]:   <devices>
Aug 17 16:23:45 user nova-compute[72724]:     <disk type="file" device="cdrom">
Aug 17 16:23:45 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 16:23:45 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f/disk.config"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="hda" bus="ide"/>
Aug 17 16:23:45 user nova-compute[72724]:     </disk>
Aug 17 16:23:45 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:23:45 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:45 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <serial>0b44bdbc-6571-4ff5-afa5-c50cd17f2491</serial>
Aug 17 16:23:45 user nova-compute[72724]:     </disk>
Aug 17 16:23:45 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:23:45 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:45 user nova-compute[72724]:       <source dev="/dev/sdd"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <serial>82f51d00-f47f-4c69-b95d-3cf2d5d55119</serial>
Aug 17 16:23:45 user nova-compute[72724]:     </disk>
Aug 17 16:23:45 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:23:45 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:45 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="vdc" bus="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <serial>899b34a2-503c-4785-b42c-edf92beefc26</serial>
Aug 17 16:23:45 user nova-compute[72724]:     </disk>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:ac:84:1a"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tap758b2d53-09"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:8c:4c:02"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tapa777c43d-59"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:96:86:7c"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tap18020b51-b7"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:37:23:40"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tapb3fac642-9c"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:b0:31:fd"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tap8ddfde5f-c5"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:a6:5b:d1"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tap90c074dd-d7"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:45 user nova-compute[72724]:       <mac address="fa:16:3e:05:31:fb"/>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:45 user nova-compute[72724]:       <target dev="tapa0cef184-4e"/>
Aug 17 16:23:45 user nova-compute[72724]:     </interface>
Aug 17 16:23:45 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:23:45 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f/console.log" append="off"/>
Aug 17 16:23:45 user nova-compute[72724]:     </serial>
Aug 17 16:23:45 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:23:45 user nova-compute[72724]:     <video>
Aug 17 16:23:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:45 user nova-compute[72724]:     </video>
Aug 17 16:23:45 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:23:45 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:23:45 user nova-compute[72724]:     </rng>
Aug 17 16:23:45 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:23:45 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:23:45 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:23:45 user nova-compute[72724]:     </memballoon>
Aug 17 16:23:45 user nova-compute[72724]:   </devices>
Aug 17 16:23:45 user nova-compute[72724]: </domain>
Aug 17 16:23:45 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap758b2d53-09, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap758b2d53-09, col_values=(('external_ids', {'iface-id': '758b2d53-09eb-4c58-a714-ed93860689d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:84:1a', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa777c43d-59, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa777c43d-59, col_values=(('external_ids', {'iface-id': 'a777c43d-59bc-4d73-b99c-69791dc7938b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:4c:02', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap18020b51-b7, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap18020b51-b7, col_values=(('external_ids', {'iface-id': '18020b51-b71d-4705-b14d-e53a385e5599', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:86:7c', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3fac642-9c, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3fac642-9c, col_values=(('external_ids', {'iface-id': 'b3fac642-9cee-4d26-b66f-3d939b1e8ce9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:23:40', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ddfde5f-c5, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ddfde5f-c5, col_values=(('external_ids', {'iface-id': '8ddfde5f-c528-4dd4-962e-befe7adff8cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:31:fd', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: INFO nova.compute.manager [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Took 0.86 seconds to detach 1 volumes for instance.
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap90c074dd-d7, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap90c074dd-d7, col_values=(('external_ids', {'iface-id': '90c074dd-d736-458b-932a-f0383adcce60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:5b:d1', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0cef184-4e, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa0cef184-4e, col_values=(('external_ids', {'iface-id': 'a0cef184-4efb-44e9-b54e-def6b34d364d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:31:fb', 'vm-uuid': 'de3f1276-aa06-4843-a69a-165a7c624f8f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:45 user nova-compute[72724]: INFO os_vif [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e')
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] No BDM found with device name hda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] No VIF found with MAC fa:16:3e:ac:84:1a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] No VIF found with MAC fa:16:3e:b0:31:fd, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:23:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Using config drive
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-bc0becf3-8171-4443-8d67-1a0dd5f35ee7 req-08ca4e27-1fde-43d3-bd02-3d4c1890372c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bc0becf3-8171-4443-8d67-1a0dd5f35ee7 req-08ca4e27-1fde-43d3-bd02-3d4c1890372c service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bc0becf3-8171-4443-8d67-1a0dd5f35ee7 req-08ca4e27-1fde-43d3-bd02-3d4c1890372c service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bc0becf3-8171-4443-8d67-1a0dd5f35ee7 req-08ca4e27-1fde-43d3-bd02-3d4c1890372c service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-bc0becf3-8171-4443-8d67-1a0dd5f35ee7 req-08ca4e27-1fde-43d3-bd02-3d4c1890372c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:45 user nova-compute[72724]: WARNING nova.compute.manager [req-bc0becf3-8171-4443-8d67-1a0dd5f35ee7 req-08ca4e27-1fde-43d3-bd02-3d4c1890372c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 16:23:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:23:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:46 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Deleted allocations for instance 6012ffd1-9d5e-48e3-8331-303109d68e0f
Aug 17 16:23:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Creating config drive at /opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f/disk.config
Aug 17 16:23:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprz6t190e {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-67fd8676-0d5d-45e6-9ed0-977f91d5678b tempest-DeleteServersTestJSON-982797275 tempest-DeleteServersTestJSON-982797275-project-member] Lock "6012ffd1-9d5e-48e3-8331-303109d68e0f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.286s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmprz6t190e" returned: 0 in 0.073s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-4f5020b6-64e1-48b1-b73d-6ecffc756d83 req-be50acbd-abda-4dee-b0ce-1442f6b4bfb4 service nova] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Received event network-vif-deleted-c376d81c-d404-4f58-a623-8aa2b7181f0a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG nova.objects.instance [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lazy-loading 'flavor' on Instance uuid 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:47 user nova-compute[72724]: INFO nova.compute.manager [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Attaching volume e556685c-37be-499b-a778-ca873766e573 to /dev/sdc
Aug 17 16:23:47 user nova-compute[72724]: DEBUG os_brick.utils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Snapshot image upload complete
Aug 17 16:23:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc666dde-4786-4dff-a819-6ca8c37e5c3b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cead9d-6ec1-455f-b173-1d6ef0243a83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f75ce9-6a41-43c8-84a4-014e18deabdf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04942e70-843b-48f0-ae7a-7baca03ad7e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:47 user nova-compute[72724]: INFO nova.compute.manager [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Shelve offloading
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:47 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce550341-d513-44f4-93c2-c10224445e01]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG os_brick.utils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updating existing volume attachment record: 625baf4c-6199-4846-a305-a4956164f274 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance destroyed successfully.
Aug 17 16:23:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:47 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-31fd9928-cd03-4167-9da4-7dfc4dd223af req-eaf9fe92-a7e1-4e3e-a278-64bc27518eae service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-31fd9928-cd03-4167-9da4-7dfc4dd223af req-eaf9fe92-a7e1-4e3e-a278-64bc27518eae service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-31fd9928-cd03-4167-9da4-7dfc4dd223af req-eaf9fe92-a7e1-4e3e-a278-64bc27518eae service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-31fd9928-cd03-4167-9da4-7dfc4dd223af req-eaf9fe92-a7e1-4e3e-a278-64bc27518eae service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-31fd9928-cd03-4167-9da4-7dfc4dd223af req-eaf9fe92-a7e1-4e3e-a278-64bc27518eae service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:48 user nova-compute[72724]: WARNING nova.compute.manager [req-31fd9928-cd03-4167-9da4-7dfc4dd223af req-eaf9fe92-a7e1-4e3e-a278-64bc27518eae service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 for instance with vm_state building and task_state spawning.
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.network.neutron [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-91f13cb6-df5e-4511-b95b-3efc148b7c39 req-8bcc9986-7cfb-4894-be63-c36a5d841935 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-91f13cb6-df5e-4511-b95b-3efc148b7c39 req-8bcc9986-7cfb-4894-be63-c36a5d841935 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-91f13cb6-df5e-4511-b95b-3efc148b7c39 req-8bcc9986-7cfb-4894-be63-c36a5d841935 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-91f13cb6-df5e-4511-b95b-3efc148b7c39 req-8bcc9986-7cfb-4894-be63-c36a5d841935 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-91f13cb6-df5e-4511-b95b-3efc148b7c39 req-8bcc9986-7cfb-4894-be63-c36a5d841935 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:48 user nova-compute[72724]: WARNING nova.compute.manager [req-91f13cb6-df5e-4511-b95b-3efc148b7c39 req-8bcc9986-7cfb-4894-be63-c36a5d841935 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 for instance with vm_state building and task_state spawning.
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-0e347662-d1b2-4955-9df8-d8f731eda32a req-a9f61336-ae58-4b6c-8ede-18e693cb2718 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e347662-d1b2-4955-9df8-d8f731eda32a req-a9f61336-ae58-4b6c-8ede-18e693cb2718 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e347662-d1b2-4955-9df8-d8f731eda32a req-a9f61336-ae58-4b6c-8ede-18e693cb2718 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e347662-d1b2-4955-9df8-d8f731eda32a req-a9f61336-ae58-4b6c-8ede-18e693cb2718 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-0e347662-d1b2-4955-9df8-d8f731eda32a req-a9f61336-ae58-4b6c-8ede-18e693cb2718 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:48 user nova-compute[72724]: WARNING nova.compute.manager [req-0e347662-d1b2-4955-9df8-d8f731eda32a req-a9f61336-ae58-4b6c-8ede-18e693cb2718 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b for instance with vm_state building and task_state spawning.
Aug 17 16:23:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-9eb6c92a-89ac-464d-8105-dad2ca5badca req-e51895e0-4af2-49bd-8e50-b627a0770ac1 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance destroyed successfully.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'resources' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-598960467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-598960467',id=3,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1S2U12q5XINVADtNiCYU+kxRLjdYC41oNeqB6/Ik3Y5bQlkgACwecUp9tCsemyfBWU7IEYLJGNQHWuk3ln03j/NicNbuIe/pUxMeSCvCGQEZBLy8KOEURrspLreUwl9Q==',key_name='tempest-keypair-513051232',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-o12a1ie6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member',shelved_at='2023-08-17T16:23:47.659480',shelved_host='user',shelved_image_id='c1280c96-2a67-4163-84fb-5904e2cb96c8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=254406ea-145e-40ff-8252-9e4a28db4892,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_vif [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf4682ae-3a, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: INFO os_vif [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a')
Aug 17 16:23:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Deleting instance files /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892_del
Aug 17 16:23:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Deletion of /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892_del complete
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Deleted allocations for instance 254406ea-145e-40ff-8252-9e4a28db4892
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'numa_topology' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.compute.manager [req-b093c474-f3b0-4126-a479-0a96d321c02b req-b21fe0cf-b22c-4fcc-95a6-d5af7a12cdee service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d for instance with vm_state building and task_state spawning.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:23:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Creating image(s)
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Ensure instance console log exists: /opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Start _get_guest_xml network_info=[{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d90751e-de20-48b6-8ac7-165de8bcf60f', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IupchVKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4', 'serial': 'a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None}, {'attachment_id': '0f66cc01-a7e9-440e-bcdf-53ecd555c339', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIijdMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f', 'attached_at': '', 'detached_at': '', 'volume_id': '039bd2db-7ceb-401c-a10b-4cd8bcfcd97b', 'serial': '039bd2db-7ceb-401c-a10b-4cd8bcfcd97b'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 1, 'volume_type': None}, {'attachment_id': 'cde78bbf-2eda-4003-9ce0-a74a672e5406', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyfzCGqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f', 'attached_at': '', 'detached_at': '', 'volume_id': '1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4', 'serial': '1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 2, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:23:50 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IupchVKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:50 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecf36f9-f9e1-4daa-87cc-64d5427d9fb9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:51 user nova-compute[72724]: WARNING nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b for instance with vm_state building and task_state spawning.
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:51 user nova-compute[72724]: WARNING nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 for instance with vm_state building and task_state spawning.
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing instance network info cache due to event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.network.neutron [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb9c134d-45c6-47ea-9180-357e54719415]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4] added
Aug 17 16:23:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.034s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edfd331-d0b1-4dc2-832e-7f9661a6bee5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b2b2ae-48af-4292-8ecc-e5d94b6224d1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IupchVKU {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IupchVKU" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e77172-972d-452f-bb58-f6565cb2a0e9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IupchVKU'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[83176b53-9e48-40ec-9bd3-8c7769687f0a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[872b9933-2639-4c15-bd51-f9fd25269319]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9d0c0c77-487f-48be-8272-0cde0915a683 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.113s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3de0196-2fc0-475e-b0ed-e7af01ba2c56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260]
Aug 17 16:23:51 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[58273ff2-fdb1-4a8b-aa3b-21062f86e1d7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5c9fb0-9c4f-4060-a3e5-d5614fb24a99]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[392ee031-1519-4bb0-a3f6-4d29b8354fee]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IupchVKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.network.neutron [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updated VIF entry in instance network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.network.neutron [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:51 user nova-compute[72724]: WARNING nova.compute.manager [req-220b34b5-9e27-43aa-aceb-7ea5385e80b0 req-7f947557-193b-4185-8cf5-9d040c933a3f service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 for instance with vm_state building and task_state spawning.
Aug 17 16:23:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== connect_volume: return (1441ms) {'type': 'block', 'scsi_wwn': '23462306232373761', 'path': '/dev/sde'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462306232373761', 'path': '/dev/sde'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIijdMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:52 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:52 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:52 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8adf1ef-e317-422d-b75f-c3d0dc3980eb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:52 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289432.4757133, de3f1276-aa06-4843-a69a-165a7c624f8f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] VM Resumed (Lifecycle Event)
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[987d5670-125f-4125-9598-c1d99cbff7b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b] added
Aug 17 16:23:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance spawned successfully.
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f1d0b-69be-4e91-9c20-c73d21837fb6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05644fc-495a-4e29-909f-99ff756aed0f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIijdMLV {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289432.4775376, de3f1276-aa06-4843-a69a-165a7c624f8f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] VM Started (Lifecycle Event)
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QIijdMLV" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a67024b-7c8e-446c-aa58-a4a717944503]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QIijdMLV'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77cd4d8-d878-4b3b-a12e-d606937a30a8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Took 12.25 seconds to spawn the instance on the hypervisor.
Aug 17 16:23:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e52ba62-d073-4eb4-b449-85f7c8371fcd]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: INFO nova.compute.manager [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Took 52.05 seconds to build instance.
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5d84c8-f09a-4df5-8dd8-9823a89c7f4a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260]
Aug 17 16:23:52 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2ed021ce-d9ef-4ffe-8123-1dd30b67b49e tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.175s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a031dfe-e89d-4c91-9a32-4732693458f4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f0d81f-935d-4843-ab18-8541041e0c3d]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:23:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:52 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:23:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.374s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcc477d-b3c1-4063-b33e-d1c58fb85bea]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIijdMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-changed-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Refreshing instance network info cache due to event network-changed-c6bf9a65-57d5-434e-9245-52872517116f. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] Acquiring lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] Acquired lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Refreshing network info cache for port c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23739363361643239', 'path': '/dev/sdf'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739363361643239', 'path': '/dev/sdf'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyfzCGqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:53 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:53 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:23:53 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d232d66c-8d5d-4ed1-8063-ac8c817c3ea6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:23:53 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34d693e-6836-4619-8010-6fde9f59276e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4] added
Aug 17 16:23:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1bd393-b8d2-4543-a508-657c187e9ead]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lazy-loading 'flavor' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e7243f-67ae-4af7-ba4b-19ff2daf091d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyfzCGqw {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JyfzCGqw" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d2d4a1-34a3-4e4f-90e1-ce38037fd3c7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JyfzCGqw'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff9aad-c501-411a-b4b0-5b78444a76bf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa9916e-f41e-41ea-8000-2c166963b6fb]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:23:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:23:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updated VIF entry in instance network info cache for port c6bf9a65-57d5-434e-9245-52872517116f. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updating instance_info_cache with network_info: [{"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1427550-a013-462f-9cfe-0b924135ce3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260]
Aug 17 16:23:54 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260] successful.
Aug 17 16:23:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c81d9b0-f963-426e-b915-ae85a4efcf29 req-206aa4cc-2e64-431a-8d9c-695a0099981b service nova] Releasing lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[938513a6-5412-4daa-8700-a6b12a2be698]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee5d4be-085a-4c46-a7cd-29721752d9ba]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:23:54 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:23:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.375s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:54 user nova-compute[72724]: INFO nova.compute.manager [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Attaching volume 69ea20c1-3d9f-4523-b659-3a9854b34dce to /dev/vdb
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[411895f7-cd74-4eb7-b8fd-8d2bf1fa8b56]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyfzCGqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.utils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f701beab-e01e-49b2-b727-7126fc7d573c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b722c28f-e2f8-4fe9-a65e-2bcc68e85ec5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5238830f-5c01-498a-bd02-4067ff696b1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a104e2-5b2f-46b1-a903-650ecd9813df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:23:54 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:23:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7700613-529d-4ce0-8047-244da72f705b]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG os_brick.utils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:54 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updating existing volume attachment record: 0638f405-2a6d-47c4-be56-ffcdbec5b3e1 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-changed-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Refreshing instance network info cache due to event network-changed-a8d94a49-1d51-4196-93c2-d171ae349cd5. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] Acquiring lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] Acquired lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Refreshing network info cache for port a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== connect_volume: return (1429ms) {'type': 'block', 'scsi_wwn': '23335333365363633', 'path': '/dev/sdg'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335333365363633', 'path': '/dev/sdg'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lazy-loading 'pci_devices' on Instance uuid 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:23:55 user nova-compute[72724]:   <uuid>32ed3fdd-0833-44a4-b302-8a6ad3b9c15f</uuid>
Aug 17 16:23:55 user nova-compute[72724]:   <name>instance-00000009</name>
Aug 17 16:23:55 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:23:55 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:23:55 user nova-compute[72724]:   <metadata>
Aug 17 16:23:55 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:23:55 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:23:55 user nova-compute[72724]:       <nova:name>tempest-device-tagging-server-1087705874</nova:name>
Aug 17 16:23:55 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:23:50</nova:creationTime>
Aug 17 16:23:55 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:23:55 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:23:55 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:23:55 user nova-compute[72724]:       <nova:owner>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:user uuid="5cd148f811734a8db6c8658ecc00caf5">tempest-TaggedBootDevicesTest_v242-163224499-project-member</nova:user>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:project uuid="5dbe91ac114e41c3b78db18dbf445d00">tempest-TaggedBootDevicesTest_v242-163224499</nova:project>
Aug 17 16:23:55 user nova-compute[72724]:       </nova:owner>
Aug 17 16:23:55 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:23:55 user nova-compute[72724]:       <nova:ports>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="30053a0b-9af1-4a83-b2fb-aeef68758317">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="c9d0e07d-2f62-4841-b85e-264704ad8a36">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.54" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="35d9f38e-21cb-4b84-9ca1-70bf70001b23">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.213" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="81abc5ef-5731-40b6-92e1-9f92ecfbfcc1">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="ae01c189-8507-462e-9590-fd829544bd96">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:         <nova:port uuid="d780aa98-e043-4055-8af9-1f52567806c5">
Aug 17 16:23:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 17 16:23:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:23:55 user nova-compute[72724]:       </nova:ports>
Aug 17 16:23:55 user nova-compute[72724]:     </nova:instance>
Aug 17 16:23:55 user nova-compute[72724]:   </metadata>
Aug 17 16:23:55 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:23:55 user nova-compute[72724]:     <system>
Aug 17 16:23:55 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:23:55 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:23:55 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:23:55 user nova-compute[72724]:       <entry name="serial">32ed3fdd-0833-44a4-b302-8a6ad3b9c15f</entry>
Aug 17 16:23:55 user nova-compute[72724]:       <entry name="uuid">32ed3fdd-0833-44a4-b302-8a6ad3b9c15f</entry>
Aug 17 16:23:55 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:23:55 user nova-compute[72724]:     </system>
Aug 17 16:23:55 user nova-compute[72724]:   </sysinfo>
Aug 17 16:23:55 user nova-compute[72724]:   <os>
Aug 17 16:23:55 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:23:55 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:23:55 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:23:55 user nova-compute[72724]:   </os>
Aug 17 16:23:55 user nova-compute[72724]:   <features>
Aug 17 16:23:55 user nova-compute[72724]:     <acpi/>
Aug 17 16:23:55 user nova-compute[72724]:     <apic/>
Aug 17 16:23:55 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:23:55 user nova-compute[72724]:   </features>
Aug 17 16:23:55 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:23:55 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:23:55 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:23:55 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:23:55 user nova-compute[72724]:   </clock>
Aug 17 16:23:55 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:23:55 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:23:55 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:23:55 user nova-compute[72724]:   </cpu>
Aug 17 16:23:55 user nova-compute[72724]:   <devices>
Aug 17 16:23:55 user nova-compute[72724]:     <disk type="file" device="cdrom">
Aug 17 16:23:55 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none"/>
Aug 17 16:23:55 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f/disk.config"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="hda" bus="ide"/>
Aug 17 16:23:55 user nova-compute[72724]:     </disk>
Aug 17 16:23:55 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:23:55 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:55 user nova-compute[72724]:       <source dev="/dev/sde"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <serial>a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4</serial>
Aug 17 16:23:55 user nova-compute[72724]:     </disk>
Aug 17 16:23:55 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:23:55 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:55 user nova-compute[72724]:       <source dev="/dev/sdf"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <serial>039bd2db-7ceb-401c-a10b-4cd8bcfcd97b</serial>
Aug 17 16:23:55 user nova-compute[72724]:     </disk>
Aug 17 16:23:55 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:23:55 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:23:55 user nova-compute[72724]:       <source dev="/dev/sdg"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="vdc" bus="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <serial>1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4</serial>
Aug 17 16:23:55 user nova-compute[72724]:     </disk>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:b7:d6:c7"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tap30053a0b-9a"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:58:1d:71"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tapc9d0e07d-2f"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:db:d7:0d"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tap35d9f38e-21"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:a9:37:cd"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tap81abc5ef-57"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:f6:a0:d2"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tap41d6bc13-9f"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:71:8a:3f"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tapae01c189-85"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:23:55 user nova-compute[72724]:       <mac address="fa:16:3e:3d:c7:93"/>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:23:55 user nova-compute[72724]:       <target dev="tapd780aa98-e0"/>
Aug 17 16:23:55 user nova-compute[72724]:     </interface>
Aug 17 16:23:55 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:23:55 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f/console.log" append="off"/>
Aug 17 16:23:55 user nova-compute[72724]:     </serial>
Aug 17 16:23:55 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:23:55 user nova-compute[72724]:     <video>
Aug 17 16:23:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:23:55 user nova-compute[72724]:     </video>
Aug 17 16:23:55 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:23:55 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:23:55 user nova-compute[72724]:     </rng>
Aug 17 16:23:55 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:23:55 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:23:55 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:23:55 user nova-compute[72724]:     </memballoon>
Aug 17 16:23:55 user nova-compute[72724]:   </devices>
Aug 17 16:23:55 user nova-compute[72724]: </domain>
Aug 17 16:23:55 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30053a0b-9a, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30053a0b-9a, col_values=(('external_ids', {'iface-id': '30053a0b-9af1-4a83-b2fb-aeef68758317', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:d6:c7', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d0e07d-2f, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9d0e07d-2f, col_values=(('external_ids', {'iface-id': 'c9d0e07d-2f62-4841-b85e-264704ad8a36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:1d:71', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap35d9f38e-21, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap35d9f38e-21, col_values=(('external_ids', {'iface-id': '35d9f38e-21cb-4b84-9ca1-70bf70001b23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:d7:0d', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap81abc5ef-57, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap81abc5ef-57, col_values=(('external_ids', {'iface-id': '81abc5ef-5731-40b6-92e1-9f92ecfbfcc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:37:cd', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41d6bc13-9f, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap41d6bc13-9f, col_values=(('external_ids', {'iface-id': '41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:a0:d2', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae01c189-85, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae01c189-85, col_values=(('external_ids', {'iface-id': 'ae01c189-8507-462e-9590-fd829544bd96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:8a:3f', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd780aa98-e0, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd780aa98-e0, col_values=(('external_ids', {'iface-id': 'd780aa98-e043-4055-8af9-1f52567806c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:c7:93', 'vm-uuid': '32ed3fdd-0833-44a4-b302-8a6ad3b9c15f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:55 user nova-compute[72724]: INFO os_vif [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0')
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] No BDM found with device name hda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] No VIF found with MAC fa:16:3e:b7:d6:c7, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:23:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] No VIF found with MAC fa:16:3e:f6:a0:d2, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:23:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Using config drive
Aug 17 16:23:56 user nova-compute[72724]: DEBUG nova.network.neutron [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updated VIF entry in instance network info cache for port a8d94a49-1d51-4196-93c2-d171ae349cd5. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:23:56 user nova-compute[72724]: DEBUG nova.network.neutron [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updating instance_info_cache with network_info: [{"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:23:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ced4c12e-e67e-41e0-95dd-ee6697773eb9 req-3a5558f0-0f32-4843-9269-3d15db299a12 service nova] Releasing lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:23:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Creating config drive at /opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f/disk.config
Aug 17 16:23:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa6m_4g_c {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:23:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpa6m_4g_c" returned: 0 in 0.058s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:23:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:57 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289422.7873127, 6012ffd1-9d5e-48e3-8331-303109d68e0f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:23:57 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] VM Stopped (Lifecycle Event)
Aug 17 16:23:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-50564040-a26b-4a05-82a8-a1dc9986c46e None None] [instance: 6012ffd1-9d5e-48e3-8331-303109d68e0f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-bea4d2f6-1528-49f5-a727-01f78712e8b8 req-e06b54e7-9a29-4daf-a0eb-25b6ff724513 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bea4d2f6-1528-49f5-a727-01f78712e8b8 req-e06b54e7-9a29-4daf-a0eb-25b6ff724513 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bea4d2f6-1528-49f5-a727-01f78712e8b8 req-e06b54e7-9a29-4daf-a0eb-25b6ff724513 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bea4d2f6-1528-49f5-a727-01f78712e8b8 req-e06b54e7-9a29-4daf-a0eb-25b6ff724513 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-bea4d2f6-1528-49f5-a727-01f78712e8b8 req-e06b54e7-9a29-4daf-a0eb-25b6ff724513 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:58 user nova-compute[72724]: WARNING nova.compute.manager [req-bea4d2f6-1528-49f5-a727-01f78712e8b8 req-e06b54e7-9a29-4daf-a0eb-25b6ff724513 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 for instance with vm_state building and task_state spawning.
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-5a50047e-f6b8-4a34-8a3d-0d1557bb03eb req-857c394e-cb21-4831-a765-4862f41e93e4 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5a50047e-f6b8-4a34-8a3d-0d1557bb03eb req-857c394e-cb21-4831-a765-4862f41e93e4 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5a50047e-f6b8-4a34-8a3d-0d1557bb03eb req-857c394e-cb21-4831-a765-4862f41e93e4 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5a50047e-f6b8-4a34-8a3d-0d1557bb03eb req-857c394e-cb21-4831-a765-4862f41e93e4 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-5a50047e-f6b8-4a34-8a3d-0d1557bb03eb req-857c394e-cb21-4831-a765-4862f41e93e4 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:23:58 user nova-compute[72724]: WARNING nova.compute.manager [req-5a50047e-f6b8-4a34-8a3d-0d1557bb03eb req-857c394e-cb21-4831-a765-4862f41e93e4 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 for instance with vm_state building and task_state spawning.
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289424.0306253, 254406ea-145e-40ff-8252-9e4a28db4892 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:23:59 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] VM Stopped (Lifecycle Event)
Aug 17 16:23:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2b318574-6f13-4431-b959-ddf5264d12bb None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:23:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-c1baf248-baa5-4d56-ab94-f156f37e3832 req-e3824b8f-1073-44f0-92e5-752218a5c153 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c1baf248-baa5-4d56-ab94-f156f37e3832 req-e3824b8f-1073-44f0-92e5-752218a5c153 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c1baf248-baa5-4d56-ab94-f156f37e3832 req-e3824b8f-1073-44f0-92e5-752218a5c153 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c1baf248-baa5-4d56-ab94-f156f37e3832 req-e3824b8f-1073-44f0-92e5-752218a5c153 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-c1baf248-baa5-4d56-ab94-f156f37e3832 req-e3824b8f-1073-44f0-92e5-752218a5c153 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-c1baf248-baa5-4d56-ab94-f156f37e3832 req-e3824b8f-1073-44f0-92e5-752218a5c153 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-9677d91f-5dd1-44e3-b9df-cdebd2f0e127 req-4aed92d9-4f98-483a-bd85-52bd198ecc73 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-05ba2d46-c8bb-4517-b55b-ce5c682974dd req-3fcb9bad-eaa8-4e41-9384-a441a516a3af service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-05ba2d46-c8bb-4517-b55b-ce5c682974dd req-3fcb9bad-eaa8-4e41-9384-a441a516a3af service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-05ba2d46-c8bb-4517-b55b-ce5c682974dd req-3fcb9bad-eaa8-4e41-9384-a441a516a3af service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-05ba2d46-c8bb-4517-b55b-ce5c682974dd req-3fcb9bad-eaa8-4e41-9384-a441a516a3af service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-05ba2d46-c8bb-4517-b55b-ce5c682974dd req-3fcb9bad-eaa8-4e41-9384-a441a516a3af service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:00 user nova-compute[72724]: WARNING nova.compute.manager [req-05ba2d46-c8bb-4517-b55b-ce5c682974dd req-3fcb9bad-eaa8-4e41-9384-a441a516a3af service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 for instance with vm_state building and task_state spawning.
Aug 17 16:24:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-5fe535ec-93ed-461e-ba58-60233a0c042b req-160036c1-2cce-42c5-ad1f-ea8b0235ce6f service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5fe535ec-93ed-461e-ba58-60233a0c042b req-160036c1-2cce-42c5-ad1f-ea8b0235ce6f service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5fe535ec-93ed-461e-ba58-60233a0c042b req-160036c1-2cce-42c5-ad1f-ea8b0235ce6f service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5fe535ec-93ed-461e-ba58-60233a0c042b req-160036c1-2cce-42c5-ad1f-ea8b0235ce6f service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-5fe535ec-93ed-461e-ba58-60233a0c042b req-160036c1-2cce-42c5-ad1f-ea8b0235ce6f service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:02 user nova-compute[72724]: WARNING nova.compute.manager [req-5fe535ec-93ed-461e-ba58-60233a0c042b req-160036c1-2cce-42c5-ad1f-ea8b0235ce6f service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 for instance with vm_state building and task_state spawning.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'flavor' on Instance uuid 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:02 user nova-compute[72724]: WARNING nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 for instance with vm_state building and task_state spawning.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:02 user nova-compute[72724]: WARNING nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 for instance with vm_state building and task_state spawning.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:02 user nova-compute[72724]: WARNING nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 for instance with vm_state building and task_state spawning.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:02 user nova-compute[72724]: WARNING nova.compute.manager [req-061d1d60-e725-4cdd-b160-8c35412e6b2a req-5fa14b71-cc90-496a-9013-7ef6adfb63c0 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 for instance with vm_state building and task_state spawning.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Attaching volume 6f2d9af9-b1dc-4454-96e1-a9deb428f7cd to /dev/vdb
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289442.6086018, 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] VM Resumed (Lifecycle Event)
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance spawned successfully.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG os_brick.utils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d4cc6-5218-4251-a4ee-c7c84deb6bb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289442.6182737, 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] VM Started (Lifecycle Event)
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[34653c56-8247-457b-8084-fed52d73bedc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a48276-4f6b-46ed-9b3a-f70cd25c0a6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[324d1f3c-a3cf-4f9b-be0f-e97b5272a712]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Took 11.92 seconds to spawn the instance on the hypervisor.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:24:02 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caf6804-ccd0-4312-a86e-a6ddc7b4f8d8]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG os_brick.utils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:02 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updating existing volume attachment record: b24f599b-a4ee-41fd-8a9f-2c59ef2cdc1a {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Took 51.33 seconds to build instance.
Aug 17 16:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1661ac33-65c0-40d0-b020-a28c20d780f7 tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 51.483s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "interface-f3f221f6-da33-46ff-be72-aadc05e46d8a-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "interface-f3f221f6-da33-46ff-be72-aadc05e46d8a-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'flavor' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-changed-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Refreshing instance network info cache due to event network-changed-5a7d507b-63c6-47b2-9e30-c37f05e03f1e. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] Acquiring lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] Acquired lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Refreshing network info cache for port 5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'pci_requests' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.policy [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9e1309addf494df99a5a660510c89a01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1423d90110e74cd5aef429873bd098ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updated VIF entry in instance network info cache for port 5a7d507b-63c6-47b2-9e30-c37f05e03f1e. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e31f2803-5e8c-431e-954a-3ac4f9d46fc5 req-f84baa2f-ed82-40f0-a59f-84733aa09bd9 service nova] Releasing lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:05 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Successfully created port: 7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:24:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Successfully updated port: 7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquired lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-changed-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Refreshing instance network info cache due to event network-changed-7164611e-4161-423a-a30c-365ae12bae04. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] Acquiring lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Releasing lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] Acquired lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Refreshing network info cache for port 7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG os_vif [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7164611e-41, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7164611e-41, col_values=(('external_ids', {'iface-id': '7164611e-4161-423a-a30c-365ae12bae04', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:d4:59', 'vm-uuid': 'f3f221f6-da33-46ff-be72-aadc05e46d8a'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: INFO os_vif [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41')
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] attach device xml: <interface type="ethernet">
Aug 17 16:24:07 user nova-compute[72724]:   <mac address="fa:16:3e:48:d4:59"/>
Aug 17 16:24:07 user nova-compute[72724]:   <model type="virtio"/>
Aug 17 16:24:07 user nova-compute[72724]:   <mtu size="1442"/>
Aug 17 16:24:07 user nova-compute[72724]:   <target dev="tap7164611e-41"/>
Aug 17 16:24:07 user nova-compute[72724]: </interface>
Aug 17 16:24:07 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No BDM found with device name hda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No VIF found with MAC fa:16:3e:31:be:0a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-98aceeb0-d078-4ee4-8142-4f8ab5dfdbff req-a0a17a70-e7f4-4493-b696-b88b694ad993 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-98aceeb0-d078-4ee4-8142-4f8ab5dfdbff req-a0a17a70-e7f4-4493-b696-b88b694ad993 service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-98aceeb0-d078-4ee4-8142-4f8ab5dfdbff req-a0a17a70-e7f4-4493-b696-b88b694ad993 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-98aceeb0-d078-4ee4-8142-4f8ab5dfdbff req-a0a17a70-e7f4-4493-b696-b88b694ad993 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-98aceeb0-d078-4ee4-8142-4f8ab5dfdbff req-a0a17a70-e7f4-4493-b696-b88b694ad993 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:07 user nova-compute[72724]: WARNING nova.compute.manager [req-98aceeb0-d078-4ee4-8142-4f8ab5dfdbff req-a0a17a70-e7f4-4493-b696-b88b694ad993 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 for instance with vm_state active and task_state None.
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:07 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:07 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:07 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:07</nova:creationTime>
Aug 17 16:24:07 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:07 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:07 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:07 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:07 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:07 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:07 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:07 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:07 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:07 user nova-compute[72724]:     <nova:port uuid="7164611e-4161-423a-a30c-365ae12bae04">
Aug 17 16:24:07 user nova-compute[72724]:       <nova:ip type="fixed" address="10.10.10.169" ipVersion="4"/>
Aug 17 16:24:07 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:07 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:07 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:07 user nova-compute[72724]:  {{(pid=72724) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ad0229e-1c89-466f-9b00-53aa0732d7d3 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "interface-f3f221f6-da33-46ff-be72-aadc05e46d8a-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.315s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updated VIF entry in instance network info cache for port 7164611e-4161-423a-a30c-365ae12bae04. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c4683f34-e5cb-4df5-b274-9734d58bc032 req-68e9844a-3133-4457-be55-e0b0730ce162 service nova] Releasing lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuJPaBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:08 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:08 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:08 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e36ff389-79d6-47f1-bf24-54eedab6bd0b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:24:08 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[745dbf90-32fa-4c3d-b211-7d0f287c7ceb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce] added
Aug 17 16:24:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d472489e-0ad3-4195-a5db-09ce6822df3c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b18fe1-23e3-41c2-b39c-a5cb0829aa51]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuJPaBhp {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FuJPaBhp" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d13aaa6-b4d7-49ef-9b79-9ae863ba8459]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FuJPaBhp'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c5590c-403b-4e0f-9d2e-b43e5406fa59]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5429661b-5534-4629-a51d-19f82866add2]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --login" returned: 0 in 0.232s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ed62f5-08ce-43ea-8b8f-dad36f9cf2b3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260]
Aug 17 16:24:08 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'flavor' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb0c0dd-0fc6-4945-a05c-02ef64f5969c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.432s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dac55ea-acc2-4fd7-b5ba-f6bd51b76a36]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:08 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.660s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[deec5ac9-1236-40b7-af8d-254b89392fa6]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:24:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuJPaBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:09 user nova-compute[72724]: INFO nova.compute.manager [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Attaching volume 510981fd-85e0-4162-9bb9-5753fe69166d to /dev/vdb
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.utils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc75b774-f32b-4111-9d89-2a19e0c197b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b40f47f-f192-4a7d-a916-f3305c1e5469]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[711470d0-b350-455a-9f94-24d7cc4aff09]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7415f8-1c95-4e16-88ea-55e51caf7d69]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:24:09 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a651789e-78ee-47a6-98cf-c69dcb5eb3ee]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.utils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating existing volume attachment record: 4927165a-0a88-4c85-b1dd-5a3b046831ee {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-27107fb9-3df5-4603-80f5-1621402194bf req-c4fb276f-ab12-4cd7-a2f4-88c4bdc05c6c service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-27107fb9-3df5-4603-80f5-1621402194bf req-c4fb276f-ab12-4cd7-a2f4-88c4bdc05c6c service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-27107fb9-3df5-4603-80f5-1621402194bf req-c4fb276f-ab12-4cd7-a2f4-88c4bdc05c6c service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-27107fb9-3df5-4603-80f5-1621402194bf req-c4fb276f-ab12-4cd7-a2f4-88c4bdc05c6c service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-27107fb9-3df5-4603-80f5-1621402194bf req-c4fb276f-ab12-4cd7-a2f4-88c4bdc05c6c service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:09 user nova-compute[72724]: WARNING nova.compute.manager [req-27107fb9-3df5-4603-80f5-1621402194bf req-c4fb276f-ab12-4cd7-a2f4-88c4bdc05c6c service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 for instance with vm_state active and task_state None.
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.698s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] <== connect_volume: return (1700ms) {'type': 'block', 'scsi_wwn': '23739356265643335', 'path': '/dev/sdh'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739356265643335', 'path': '/dev/sdh'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lazy-loading 'flavor' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] attach device xml: <disk type="block" device="disk">
Aug 17 16:24:09 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:09 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:09 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:09 user nova-compute[72724]:   <serial>69ea20c1-3d9f-4523-b659-3a9854b34dce</serial>
Aug 17 16:24:09 user nova-compute[72724]: </disk>
Aug 17 16:24:09 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:24:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] No VIF found with MAC fa:16:3e:5e:91:c1, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIrOqvfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:11 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:11 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:11 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f654e2a3-6b3a-48ff-8423-06668202782e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:24:11 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2086ebb2-fc5c-4cce-b2dd-1ca595e6e132]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573] added
Aug 17 16:24:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e1ee2-9d97-4858-a049-30dcedff7b60]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac6caa-4ac3-4180-a1d5-3a4c2c2febed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIrOqvfw {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIrOqvfw" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b411d6e3-c80c-41da-b6dc-d608e7a7d65f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIrOqvfw'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa27701-fdf2-4cb0-bc0c-d3374e9ce6d9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8b7ca2-1c54-4631-b19d-93f9f6816031]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb0e3ae-9e71-4f4a-bc71-56abee67316c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260]
Aug 17 16:24:11 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c7212e-61f2-4507-9f79-7e6516dcc636]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ec30dbc1-096e-4379-9a66-b27c782c7507 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.274s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d848d-a779-4216-8c5c-b8dbf9ad5b58]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:11 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15d3f09-7a80-4f98-bf1a-057fc0404c17]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:24:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIrOqvfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] volume_snapshot_create: create_info: {'snapshot_id': '83515711-5f7e-40f9-a71a-a144e936c945', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=72724) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] snap xml: <domainsnapshot>
Aug 17 16:24:12 user nova-compute[72724]:   <disks>
Aug 17 16:24:12 user nova-compute[72724]:     <disk name="/dev/sdh" snapshot="external" type="file">
Aug 17 16:24:12 user nova-compute[72724]:       <source file="/dev/new_file"/>
Aug 17 16:24:12 user nova-compute[72724]:     </disk>
Aug 17 16:24:12 user nova-compute[72724]:     <disk name="vda" snapshot="no"/>
Aug 17 16:24:12 user nova-compute[72724]:   </disks>
Aug 17 16:24:12 user nova-compute[72724]: </domainsnapshot>
Aug 17 16:24:12 user nova-compute[72724]:  {{(pid=72724) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lazy-loading 'system_metadata' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26333653032303564', 'path': '/dev/sdi'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333653032303564', 'path': '/dev/sdi'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lazy-loading 'flavor' on Instance uuid 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8120e490-f6ec-4356-99cc-c36baeafe1a2 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] volume_snapshot_delete: delete_info: {'volume_id': '69ea20c1-3d9f-4523-b659-3a9854b34dce'} {{(pid=72724) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [None req-8120e490-f6ec-4356-99cc-c36baeafe1a2 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     if delete_info['type'] != 'qcow2':
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] KeyError: 'type'
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     rv = execute(f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     six.reraise(c, e, tb)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     raise value
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     rv = meth(*args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     self._volume_snapshot_create(context, instance, guest,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     rv = execute(f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     six.reraise(c, e, tb)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     raise value
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     rv = meth(*args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] 
Aug 17 16:24:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:24:12 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:12 user nova-compute[72724]:   <source dev="/dev/sdi"/>
Aug 17 16:24:12 user nova-compute[72724]:   <target dev="sdc" bus="scsi"/>
Aug 17 16:24:12 user nova-compute[72724]:   <serial>e556685c-37be-499b-a778-ca873766e573</serial>
Aug 17 16:24:12 user nova-compute[72724]:   <address type="drive" controller="0" unit="2"/>
Aug 17 16:24:12 user nova-compute[72724]: </disk>
Aug 17 16:24:12 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [None req-8120e490-f6ec-4356-99cc-c36baeafe1a2 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-5c2dcb3f-29c7-457e-b8a9-f67867ae9857)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server [None req-8120e490-f6ec-4356-99cc-c36baeafe1a2 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Exception during message handling: KeyError: 'type'
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 83515711-5f7e-40f9-a71a-a144e936c945 could not be found.
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise value
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 83515711-5f7e-40f9-a71a-a144e936c945 could not be found. (HTTP 404) (Request-ID: req-11daf9f8-7a0b-4ea2-b262-b21a4ed09f16)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 83515711-5f7e-40f9-a71a-a144e936c945 could not be found.
Aug 17 16:24:12 user nova-compute[72724]: ERROR nova.virt.libvirt.driver 
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server [None req-0f4f11b4-f152-41d5-9e2a-28873e42537c tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     raise value
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 17 16:24:12 user nova-compute[72724]: ERROR oslo_messaging.rpc.server 
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:13 user nova-compute[72724]: INFO nova.compute.manager [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Detaching volume 69ea20c1-3d9f-4523-b659-3a9854b34dce
Aug 17 16:24:13 user nova-compute[72724]: INFO nova.virt.block_device [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Attempting to driver detach volume 69ea20c1-3d9f-4523-b659-3a9854b34dce from mountpoint /dev/vdb
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Attempting to detach device vdb from instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:13 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:13 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:13 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:13 user nova-compute[72724]:   <serial>69ea20c1-3d9f-4523-b659-3a9854b34dce</serial>
Aug 17 16:24:13 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:24:13 user nova-compute[72724]: </disk>
Aug 17 16:24:13 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Successfully detached device vdb from instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc from the persistent domain config.
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:13 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:13 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:13 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:13 user nova-compute[72724]:   <serial>69ea20c1-3d9f-4523-b659-3a9854b34dce</serial>
Aug 17 16:24:13 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:24:13 user nova-compute[72724]: </disk>
Aug 17 16:24:13 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No BDM found with device name sda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] No VIF found with MAC fa:16:3e:45:f0:74, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82de5f49-a9c8-4a5f-bb79-78b0fc0da095 tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.860s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289453.6311269, a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:24:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Successfully detached device vdb from instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc from the live domain config.
Aug 17 16:24:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FuJPaBhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:13 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ae7fd8-fcb8-4b54-95d3-0bfb9306e3d7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d6a81a-e726-4e44-ba0e-3ace7e1deabb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:13 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81be0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce'): ({'sdh'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Removing single pathed devices sdh {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd00cb76-fa24-46b7-a306-39b537b8fe68]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47e8a12-0259-41ec-9c75-c80565740ade]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Flushing IO for device /dev/sdh {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2cea76-81d1-4c13-aca4-b0cb9bbde7d9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.053s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f393434-6d9f-48a4-a567-b8435cfb69a7]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cbf83f-23db-4b53-aea5-8efdc1f38ab4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --logout" returned: 0 in 0.105s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad57ed5-cf43-448b-9d3a-d4134732f16d]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260]
Aug 17 16:24:13 user nova-compute[72724]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69ea20c1-3d9f-4523-b659-3a9854b34dce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[643f3684-9ed1-46e2-9802-41ce7f7849a8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] <== disconnect_volume: return (380ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lazy-loading 'flavor' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ecf30e9e-4741-4ca5-b358-46146a2f3615 tempest-VolumesAssistedSnapshotsTest-1836829800 tempest-VolumesAssistedSnapshotsTest-1836829800-project-admin] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.905s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:15 user nova-compute[72724]: INFO nova.compute.manager [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Detaching volume e556685c-37be-499b-a778-ca873766e573
Aug 17 16:24:15 user nova-compute[72724]: INFO nova.virt.block_device [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Attempting to driver detach volume e556685c-37be-499b-a778-ca873766e573 from mountpoint /dev/sdc
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Attempting to detach device sdc from instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:15 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:15 user nova-compute[72724]:   <source dev="/dev/sdi"/>
Aug 17 16:24:15 user nova-compute[72724]:   <target dev="sdc" bus="scsi"/>
Aug 17 16:24:15 user nova-compute[72724]:   <serial>e556685c-37be-499b-a778-ca873766e573</serial>
Aug 17 16:24:15 user nova-compute[72724]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 16:24:15 user nova-compute[72724]: </disk>
Aug 17 16:24:15 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Successfully detached device sdc from instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 from the persistent domain config.
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:15 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:15 user nova-compute[72724]:   <source dev="/dev/sdi"/>
Aug 17 16:24:15 user nova-compute[72724]:   <target dev="sdc" bus="scsi"/>
Aug 17 16:24:15 user nova-compute[72724]:   <serial>e556685c-37be-499b-a778-ca873766e573</serial>
Aug 17 16:24:15 user nova-compute[72724]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 17 16:24:15 user nova-compute[72724]: </disk>
Aug 17 16:24:15 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289455.5434287, 496b7bc3-5cfc-478b-b1f4-fbfd59426852 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:24:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Successfully detached device sdc from instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852 from the live domain config.
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIrOqvfw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:15 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.037s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e69483-3f8b-4198-a7db-5513869d320b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b92841b-5d1c-4104-b047-2051f5a51ab1]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:15 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c868c280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573'): ({'sdi'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Removing single pathed devices sdi {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5e69b0-e40e-4f00-a088-5ce6e8d58db1]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5dcf17-8be6-4deb-b83a-7b8b7d18d09e]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Flushing IO for device /dev/sdi {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d61b654-5c63-4c7f-bbc2-ba01c0b59602]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.040s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539a1cb-3978-4bc4-8c8e-76345c72a28f]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] SCSI volumes sdi have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86c7dae-4af6-4196-bb9a-5ea6185a26e5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a220877c-e9fc-4062-9d39-c1ac384d9445]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260]
Aug 17 16:24:15 user nova-compute[72724]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e556685c-37be-499b-a778-ca873766e573 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fcb8e0b-30f2-4013-9288-d5ab7eacab72]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] <== disconnect_volume: return (353ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGHlYkZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:15 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:15 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:15 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[954dd1e1-370e-4552-97b1-4dc7d9a12a64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:24:15 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b8b7f-55f8-4b1b-8667-7b51c95d952b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd] added
Aug 17 16:24:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d10543-ee47-4563-9e6e-ee328ac05b49]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[301bdc79-6995-4041-9fa2-712a19d1758a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGHlYkZn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vGHlYkZn" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce1c20-c889-4139-8465-fa71e315645e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vGHlYkZn'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ce1126-db09-4ba9-91da-f0f70a38d327]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbd05d2-7bfd-4192-afcd-dba96aaedac1]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[25372323-0a84-4f2b-a6da-e8924b0d1ef7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260]
Aug 17 16:24:16 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[73af6e96-01b6-40dd-b155-123c523c92c6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f821e11-4494-48c7-9a94-55b01a5ab317]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:16 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c9c8a9-c5c1-4727-8e5f-6f5ee458adb0]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGHlYkZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lazy-loading 'flavor' on Instance uuid 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0477671a-7655-427f-bc7a-a5288e5ee37a tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.810s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26165383637373861', 'path': '/dev/sdh'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165383637373861', 'path': '/dev/sdh'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'flavor' on Instance uuid 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:24:17 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:17 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:17 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:17 user nova-compute[72724]:   <serial>6f2d9af9-b1dc-4454-96e1-a9deb428f7cd</serial>
Aug 17 16:24:17 user nova-compute[72724]: </disk>
Aug 17 16:24:17 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:17 user nova-compute[72724]: INFO nova.compute.manager [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Terminating instance
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No VIF found with MAC fa:16:3e:cc:9e:06, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15802bcb-cdea-4df5-8058-ec862d28d555 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.554s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-da3ff068-3baa-463e-9c56-40de8775fa5b req-de52ea32-1bae-43ab-a52c-a54cfd70d9b6 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-vif-unplugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-da3ff068-3baa-463e-9c56-40de8775fa5b req-de52ea32-1bae-43ab-a52c-a54cfd70d9b6 service nova] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-da3ff068-3baa-463e-9c56-40de8775fa5b req-de52ea32-1bae-43ab-a52c-a54cfd70d9b6 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-da3ff068-3baa-463e-9c56-40de8775fa5b req-de52ea32-1bae-43ab-a52c-a54cfd70d9b6 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-da3ff068-3baa-463e-9c56-40de8775fa5b req-de52ea32-1bae-43ab-a52c-a54cfd70d9b6 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] No waiting events found dispatching network-vif-unplugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-da3ff068-3baa-463e-9c56-40de8775fa5b req-de52ea32-1bae-43ab-a52c-a54cfd70d9b6 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-vif-unplugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:24:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Instance destroyed successfully.
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lazy-loading 'resources' on Instance uuid 496b7bc3-5cfc-478b-b1f4-fbfd59426852 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:21:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-2060418484',display_name='tempest-AttachSCSIVolumeTestJSON-server-2060418484',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-2060418484',id=4,image_ref='c5ee7428-b524-43e6-ad6d-2b4b3e81458f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm05YtyapEdWqICWgLqPj+YNUDqM1QDulEqegl4NWb53GxVLuwh1ZOWzMP5rf2JJCW0u+gDt5ACf8oBLF3nwUz1/J3mai47QRST6I9MRIbnN+qu1WkofT2pQgYdj2sWfg==',key_name='tempest-keypair-1621869125',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='10a1035be40045c7a8cdfc6e32effd58',ramdisk_id='',reservation_id='r-1tnfbqp6',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c5ee7428-b524-43e6-ad6d-2b4b3e81458f',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-248490125',owner_user_name='tempest-AttachSCSIVolumeTestJSON-248490125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2fa2d03b77164cdf9d136a2fddc9ba44',uuid=496b7bc3-5cfc-478b-b1f4-fbfd59426852,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Converting VIF {"id": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "address": "fa:16:3e:45:f0:74", "network": {"id": "ec1ac4b6-535a-4555-8fd9-901af53112a2", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1260444812-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "10a1035be40045c7a8cdfc6e32effd58", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08c6bcd3-dc", "ovs_interfaceid": "08c6bcd3-dc56-4857-8a19-7348c86f2cd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG os_vif [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08c6bcd3-dc, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:18 user nova-compute[72724]: INFO os_vif [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:45:f0:74,bridge_name='br-int',has_traffic_filtering=True,id=08c6bcd3-dc56-4857-8a19-7348c86f2cd8,network=Network(ec1ac4b6-535a-4555-8fd9-901af53112a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08c6bcd3-dc')
Aug 17 16:24:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Deleting instance files /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852_del
Aug 17 16:24:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Deletion of /opt/stack/data/nova/instances/496b7bc3-5cfc-478b-b1f4-fbfd59426852_del complete
Aug 17 16:24:18 user nova-compute[72724]: INFO nova.compute.manager [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 17 16:24:18 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:24:18 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:24:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:19 user nova-compute[72724]: INFO nova.compute.manager [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Detaching volume 6f2d9af9-b1dc-4454-96e1-a9deb428f7cd
Aug 17 16:24:19 user nova-compute[72724]: INFO nova.virt.block_device [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Attempting to driver detach volume 6f2d9af9-b1dc-4454-96e1-a9deb428f7cd from mountpoint /dev/vdb
Aug 17 16:24:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Attempting to detach device vdb from instance 75fd7469-8155-43cf-a93c-fac4132c8f03 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:24:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:19 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:19 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:19 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:19 user nova-compute[72724]:   <serial>6f2d9af9-b1dc-4454-96e1-a9deb428f7cd</serial>
Aug 17 16:24:19 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:24:19 user nova-compute[72724]: </disk>
Aug 17 16:24:19 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:19 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Successfully detached device vdb from instance 75fd7469-8155-43cf-a93c-fac4132c8f03 from the persistent domain config.
Aug 17 16:24:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 75fd7469-8155-43cf-a93c-fac4132c8f03 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:24:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:19 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:19 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:19 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:19 user nova-compute[72724]:   <serial>6f2d9af9-b1dc-4454-96e1-a9deb428f7cd</serial>
Aug 17 16:24:19 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:24:19 user nova-compute[72724]: </disk>
Aug 17 16:24:19 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289460.1237466, 75fd7469-8155-43cf-a93c-fac4132c8f03 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:24:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Successfully detached device vdb from instance 75fd7469-8155-43cf-a93c-fac4132c8f03 from the live domain config.
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vGHlYkZn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:20 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b858ed0f-1214-4091-a8a4-a4cbc4606aed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca29fe2b-eb33-409f-b476-e04c455a31ed]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:20 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:20 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e83ae710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd'): ({'sdh'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Removing single pathed devices sdh {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd8320-0e61-48de-9ed8-40327c547b94]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3c4066-3bb6-41a4-b2e1-6302079c2e38]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Flushing IO for device /dev/sdh {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f260291d-acb2-4e11-a2d6-7e2f4bfaaffc]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e4da9-9151-4284-8307-70a23c83414a]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed414bd3-f776-4f54-bcbf-1774929f4145]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-eb0a164d-2799-4baf-86a1-1ca44db82c76 req-c5ccbd23-0f5f-4775-a605-b37d8bc451b6 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb0a164d-2799-4baf-86a1-1ca44db82c76 req-c5ccbd23-0f5f-4775-a605-b37d8bc451b6 service nova] Acquiring lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb0a164d-2799-4baf-86a1-1ca44db82c76 req-c5ccbd23-0f5f-4775-a605-b37d8bc451b6 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb0a164d-2799-4baf-86a1-1ca44db82c76 req-c5ccbd23-0f5f-4775-a605-b37d8bc451b6 service nova] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-eb0a164d-2799-4baf-86a1-1ca44db82c76 req-c5ccbd23-0f5f-4775-a605-b37d8bc451b6 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] No waiting events found dispatching network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:20 user nova-compute[72724]: WARNING nova.compute.manager [req-eb0a164d-2799-4baf-86a1-1ca44db82c76 req-c5ccbd23-0f5f-4775-a605-b37d8bc451b6 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received unexpected event network-vif-plugged-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 for instance with vm_state active and task_state deleting.
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1117bb99-45f6-487c-a194-dcd55ff8554d]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Took 1.69 seconds to deallocate network for instance.
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260]
Aug 17 16:24:20 user nova-compute[72724]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:20 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-027c8f87-88e3-4e45-8555-7da805858ee8 req-fca54a43-d3b7-4957-a9e0-b6ac027dc838 service nova] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Received event network-vif-deleted-08c6bcd3-dc56-4857-8a19-7348c86f2cd8 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f2d9af9-b1dc-4454-96e1-a9deb428f7cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8cf7451-7a7c-4ab8-b7d5-e1149e51291d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] <== disconnect_volume: return (390ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:24:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:21 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Deleted allocations for instance 496b7bc3-5cfc-478b-b1f4-fbfd59426852
Aug 17 16:24:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96d3f7dd-6d62-4dd2-88d5-0bfaca69cb3e tempest-AttachSCSIVolumeTestJSON-248490125 tempest-AttachSCSIVolumeTestJSON-248490125-project-member] Lock "496b7bc3-5cfc-478b-b1f4-fbfd59426852" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.330s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMdjqDcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:23 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6835f368-069e-489b-a418-5e72b6c1df76]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:24:23 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4521f5c1-a41a-4e4b-9faa-ba79830e05d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d] added
Aug 17 16:24:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05364a48-f103-4f9e-9258-ee575568d60a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2b8224-7567-441c-a647-bccf2dcd70ee]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMdjqDcG {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'flavor' on Instance uuid 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mMdjqDcG" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2dd9fd-3c3c-4131-bc4e-f4a7cf907a9f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mMdjqDcG'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a131fa-58fc-44ce-8c6e-2479a74485ee]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-592d5ba1-c611-492a-bbca-f74f39dc9a61 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.367s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad4f0c61-85d8-47ca-a0dc-08ea4940328a]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b8d61-fa24-4c9f-9574-16b12a4e5a87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260]
Aug 17 16:24:23 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7030f5f9-9ad9-4049-9446-0b2fca8bd175]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a413893-e655-4f86-82e3-a6dc94528e3f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:23 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] HCTL ('39', '-', '-', 0) found on session 13 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d86901-2656-4f95-8d2f-bddd8871d61a]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Searching for a device in session 13 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:24:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMdjqDcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:24:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] <== connect_volume: return (1353ms) {'type': 'block', 'scsi_wwn': '26565656636373261', 'path': '/dev/sdh'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565656636373261', 'path': '/dev/sdh'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:24:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'flavor' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:24:24 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:24 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:24 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:24 user nova-compute[72724]:   <serial>510981fd-85e0-4162-9bb9-5753fe69166d</serial>
Aug 17 16:24:24 user nova-compute[72724]: </disk>
Aug 17 16:24:24 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:24:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No BDM found with device name hda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] No VIF found with MAC fa:16:3e:31:be:0a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:24:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7830c053-5d37-4fe3-b421-599538d751dc tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.510s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:26 user nova-compute[72724]: INFO nova.compute.manager [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Detaching volume 510981fd-85e0-4162-9bb9-5753fe69166d
Aug 17 16:24:26 user nova-compute[72724]: INFO nova.virt.block_device [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Attempting to driver detach volume 510981fd-85e0-4162-9bb9-5753fe69166d from mountpoint /dev/vdb
Aug 17 16:24:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Attempting to detach device vdb from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:24:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:26 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:26 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:26 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:26 user nova-compute[72724]:   <serial>510981fd-85e0-4162-9bb9-5753fe69166d</serial>
Aug 17 16:24:26 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 16:24:26 user nova-compute[72724]: </disk>
Aug 17 16:24:26 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully detached device vdb from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the persistent domain config.
Aug 17 16:24:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:24:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:24:26 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:24:26 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:24:26 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:24:26 user nova-compute[72724]:   <serial>510981fd-85e0-4162-9bb9-5753fe69166d</serial>
Aug 17 16:24:26 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 16:24:26 user nova-compute[72724]: </disk>
Aug 17 16:24:26 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289467.0333018, f3f221f6-da33-46ff-be72-aadc05e46d8a => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:24:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully detached device vdb from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the live domain config.
Aug 17 16:24:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mMdjqDcG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:24:27 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04da8bbb-d48e-4dda-957b-42892526159e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[135cfcfc-8398-427b-a32e-d174c68729de]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:24:27 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:24:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8693ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d'): ({'sdh'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Removing single pathed devices sdh {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb586d7f-8b20-4539-8b26-68975604f170]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0499dc5-0f7f-401b-acb7-4990d8686b65]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Flushing IO for device /dev/sdh {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e0e11d-a440-4041-aee9-b935ab6b847c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89ee5dc-0c9c-4427-93bc-aa74a171a505]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[400cbce2-d1d7-4ffd-affd-0251764f921d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06732833-ff21-4c95-bad1-aa258babae2d]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260]
Aug 17 16:24:27 user nova-compute[72724]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d, portal: 172.16.0.220,3260] successful.
Aug 17 16:24:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:510981fd-85e0-4162-9bb9-5753fe69166d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[871acf24-f7ee-4de0-8019-bfb987e62afc]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] <== disconnect_volume: return (295ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:24:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'flavor' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0aad6d61-7c60-4bae-aec4-6dc09623148c tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.657s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "interface-f3f221f6-da33-46ff-be72-aadc05e46d8a-7164611e-4161-423a-a30c-365ae12bae04" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "interface-f3f221f6-da33-46ff-be72-aadc05e46d8a-7164611e-4161-423a-a30c-365ae12bae04" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'flavor' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface> {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface> {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Attempting to detach device tap7164611e-41 from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] detach device xml: <interface type="ethernet">
Aug 17 16:24:28 user nova-compute[72724]:   <mac address="fa:16:3e:48:d4:59"/>
Aug 17 16:24:28 user nova-compute[72724]:   <model type="virtio"/>
Aug 17 16:24:28 user nova-compute[72724]:   <mtu size="1442"/>
Aug 17 16:24:28 user nova-compute[72724]:   <target dev="tap7164611e-41"/>
Aug 17 16:24:28 user nova-compute[72724]: </interface>
Aug 17 16:24:28 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface> {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 17 16:24:28 user nova-compute[72724]:   <name>instance-00000007</name>
Aug 17 16:24:28 user nova-compute[72724]:   <uuid>f3f221f6-da33-46ff-be72-aadc05e46d8a</uuid>
Aug 17 16:24:28 user nova-compute[72724]:   <metadata>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:28 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:28 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:28 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:07</nova:creationTime>
Aug 17 16:24:28 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:28 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:28 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:28 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:28 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:28 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:28 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:28 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:28 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:28 user nova-compute[72724]:     <nova:port uuid="7164611e-4161-423a-a30c-365ae12bae04">
Aug 17 16:24:28 user nova-compute[72724]:       <nova:ip type="fixed" address="10.10.10.169" ipVersion="4"/>
Aug 17 16:24:28 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:28 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:28 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:28 user nova-compute[72724]:   </metadata>
Aug 17 16:24:28 user nova-compute[72724]:   <memory unit='KiB'>524288</memory>
Aug 17 16:24:28 user nova-compute[72724]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 16:24:28 user nova-compute[72724]:   <vcpu placement='static'>1</vcpu>
Aug 17 16:24:28 user nova-compute[72724]:   <resource>
Aug 17 16:24:28 user nova-compute[72724]:     <partition>/machine</partition>
Aug 17 16:24:28 user nova-compute[72724]:   </resource>
Aug 17 16:24:28 user nova-compute[72724]:   <sysinfo type='smbios'>
Aug 17 16:24:28 user nova-compute[72724]:     <system>
Aug 17 16:24:28 user nova-compute[72724]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 16:24:28 user nova-compute[72724]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 16:24:28 user nova-compute[72724]:       <entry name='version'>0.0.0</entry>
Aug 17 16:24:28 user nova-compute[72724]:       <entry name='serial'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:28 user nova-compute[72724]:       <entry name='uuid'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:28 user nova-compute[72724]:       <entry name='family'>Virtual Machine</entry>
Aug 17 16:24:28 user nova-compute[72724]:     </system>
Aug 17 16:24:28 user nova-compute[72724]:   </sysinfo>
Aug 17 16:24:28 user nova-compute[72724]:   <os>
Aug 17 16:24:28 user nova-compute[72724]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 16:24:28 user nova-compute[72724]:     <boot dev='hd'/>
Aug 17 16:24:28 user nova-compute[72724]:     <smbios mode='sysinfo'/>
Aug 17 16:24:28 user nova-compute[72724]:   </os>
Aug 17 16:24:28 user nova-compute[72724]:   <features>
Aug 17 16:24:28 user nova-compute[72724]:     <acpi/>
Aug 17 16:24:28 user nova-compute[72724]:     <apic/>
Aug 17 16:24:28 user nova-compute[72724]:     <vmcoreinfo state='on'/>
Aug 17 16:24:28 user nova-compute[72724]:   </features>
Aug 17 16:24:28 user nova-compute[72724]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 16:24:28 user nova-compute[72724]:     <model fallback='forbid'>Nehalem</model>
Aug 17 16:24:28 user nova-compute[72724]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 16:24:28 user nova-compute[72724]:     <feature policy='require' name='vme'/>
Aug 17 16:24:28 user nova-compute[72724]:     <feature policy='require' name='x2apic'/>
Aug 17 16:24:28 user nova-compute[72724]:     <feature policy='require' name='hypervisor'/>
Aug 17 16:24:28 user nova-compute[72724]:   </cpu>
Aug 17 16:24:28 user nova-compute[72724]:   <clock offset='utc'>
Aug 17 16:24:28 user nova-compute[72724]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 16:24:28 user nova-compute[72724]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 16:24:28 user nova-compute[72724]:     <timer name='hpet' present='no'/>
Aug 17 16:24:28 user nova-compute[72724]:   </clock>
Aug 17 16:24:28 user nova-compute[72724]:   <on_poweroff>destroy</on_poweroff>
Aug 17 16:24:28 user nova-compute[72724]:   <on_reboot>restart</on_reboot>
Aug 17 16:24:28 user nova-compute[72724]:   <on_crash>destroy</on_crash>
Aug 17 16:24:28 user nova-compute[72724]:   <devices>
Aug 17 16:24:28 user nova-compute[72724]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 16:24:28 user nova-compute[72724]:     <disk type='file' device='disk'>
Aug 17 16:24:28 user nova-compute[72724]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 16:24:28 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk' index='2'/>
Aug 17 16:24:28 user nova-compute[72724]:       <backingStore type='file' index='3'>
Aug 17 16:24:28 user nova-compute[72724]:         <format type='raw'/>
Aug 17 16:24:28 user nova-compute[72724]:         <source file='/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b'/>
Aug 17 16:24:28 user nova-compute[72724]:         <backingStore/>
Aug 17 16:24:28 user nova-compute[72724]:       </backingStore>
Aug 17 16:24:28 user nova-compute[72724]:       <target dev='vda' bus='virtio'/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='virtio-disk0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </disk>
Aug 17 16:24:28 user nova-compute[72724]:     <disk type='file' device='cdrom'>
Aug 17 16:24:28 user nova-compute[72724]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 16:24:28 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config' index='1'/>
Aug 17 16:24:28 user nova-compute[72724]:       <backingStore/>
Aug 17 16:24:28 user nova-compute[72724]:       <target dev='hda' bus='ide'/>
Aug 17 16:24:28 user nova-compute[72724]:       <readonly/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='ide0-0-0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </disk>
Aug 17 16:24:28 user nova-compute[72724]:     <controller type='usb' index='0' model='none'>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='usb'/>
Aug 17 16:24:28 user nova-compute[72724]:     </controller>
Aug 17 16:24:28 user nova-compute[72724]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='pci.0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </controller>
Aug 17 16:24:28 user nova-compute[72724]:     <controller type='ide' index='0'>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='ide'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 16:24:28 user nova-compute[72724]:     </controller>
Aug 17 16:24:28 user nova-compute[72724]:     <interface type='ethernet'>
Aug 17 16:24:28 user nova-compute[72724]:       <mac address='fa:16:3e:31:be:0a'/>
Aug 17 16:24:28 user nova-compute[72724]:       <target dev='tap5a7d507b-63'/>
Aug 17 16:24:28 user nova-compute[72724]:       <model type='virtio'/>
Aug 17 16:24:28 user nova-compute[72724]:       <mtu size='1442'/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='net0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </interface>
Aug 17 16:24:28 user nova-compute[72724]:     <interface type='ethernet'>
Aug 17 16:24:28 user nova-compute[72724]:       <mac address='fa:16:3e:48:d4:59'/>
Aug 17 16:24:28 user nova-compute[72724]:       <target dev='tap7164611e-41'/>
Aug 17 16:24:28 user nova-compute[72724]:       <model type='virtio'/>
Aug 17 16:24:28 user nova-compute[72724]:       <mtu size='1442'/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='net1'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </interface>
Aug 17 16:24:28 user nova-compute[72724]:     <serial type='pty'>
Aug 17 16:24:28 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:28 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:28 user nova-compute[72724]:       <target type='isa-serial' port='0'>
Aug 17 16:24:28 user nova-compute[72724]:         <model name='isa-serial'/>
Aug 17 16:24:28 user nova-compute[72724]:       </target>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </serial>
Aug 17 16:24:28 user nova-compute[72724]:     <console type='pty' tty='/dev/pts/6'>
Aug 17 16:24:28 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:28 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:28 user nova-compute[72724]:       <target type='serial' port='0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </console>
Aug 17 16:24:28 user nova-compute[72724]:     <input type='mouse' bus='ps2'>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='input0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </input>
Aug 17 16:24:28 user nova-compute[72724]:     <input type='keyboard' bus='ps2'>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='input1'/>
Aug 17 16:24:28 user nova-compute[72724]:     </input>
Aug 17 16:24:28 user nova-compute[72724]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 17 16:24:28 user nova-compute[72724]:       <listen type='address' address='0.0.0.0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </graphics>
Aug 17 16:24:28 user nova-compute[72724]:     <audio id='1' type='none'/>
Aug 17 16:24:28 user nova-compute[72724]:     <video>
Aug 17 16:24:28 user nova-compute[72724]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='video0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </video>
Aug 17 16:24:28 user nova-compute[72724]:     <memballoon model='virtio'>
Aug 17 16:24:28 user nova-compute[72724]:       <stats period='10'/>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='balloon0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </memballoon>
Aug 17 16:24:28 user nova-compute[72724]:     <rng model='virtio'>
Aug 17 16:24:28 user nova-compute[72724]:       <backend model='random'>/dev/urandom</backend>
Aug 17 16:24:28 user nova-compute[72724]:       <alias name='rng0'/>
Aug 17 16:24:28 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 16:24:28 user nova-compute[72724]:     </rng>
Aug 17 16:24:28 user nova-compute[72724]:   </devices>
Aug 17 16:24:28 user nova-compute[72724]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 16:24:28 user nova-compute[72724]:     <label>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</label>
Aug 17 16:24:28 user nova-compute[72724]:     <imagelabel>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</imagelabel>
Aug 17 16:24:28 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:28 user nova-compute[72724]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 16:24:28 user nova-compute[72724]:     <label>+64055:+108</label>
Aug 17 16:24:28 user nova-compute[72724]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 16:24:28 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:28 user nova-compute[72724]: </domain>
Aug 17 16:24:28 user nova-compute[72724]:  {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 16:24:28 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully detached device tap7164611e-41 from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the persistent domain config.
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] (1/8): Attempting to detach device tap7164611e-41 with device alias net1 from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:24:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] detach device xml: <interface type="ethernet">
Aug 17 16:24:28 user nova-compute[72724]:   <mac address="fa:16:3e:48:d4:59"/>
Aug 17 16:24:28 user nova-compute[72724]:   <model type="virtio"/>
Aug 17 16:24:28 user nova-compute[72724]:   <mtu size="1442"/>
Aug 17 16:24:28 user nova-compute[72724]:   <target dev="tap7164611e-41"/>
Aug 17 16:24:28 user nova-compute[72724]: </interface>
Aug 17 16:24:28 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289469.1054614, f3f221f6-da33-46ff-be72-aadc05e46d8a => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Start waiting for the detach event from libvirt for device tap7164611e-41 with device alias net1 for instance f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface> {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 17 16:24:29 user nova-compute[72724]:   <name>instance-00000007</name>
Aug 17 16:24:29 user nova-compute[72724]:   <uuid>f3f221f6-da33-46ff-be72-aadc05e46d8a</uuid>
Aug 17 16:24:29 user nova-compute[72724]:   <metadata>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:29 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:07</nova:creationTime>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:29 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:29 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:29 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:port uuid="7164611e-4161-423a-a30c-365ae12bae04">
Aug 17 16:24:29 user nova-compute[72724]:       <nova:ip type="fixed" address="10.10.10.169" ipVersion="4"/>
Aug 17 16:24:29 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:29 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:29 user nova-compute[72724]:   </metadata>
Aug 17 16:24:29 user nova-compute[72724]:   <memory unit='KiB'>524288</memory>
Aug 17 16:24:29 user nova-compute[72724]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 16:24:29 user nova-compute[72724]:   <vcpu placement='static'>1</vcpu>
Aug 17 16:24:29 user nova-compute[72724]:   <resource>
Aug 17 16:24:29 user nova-compute[72724]:     <partition>/machine</partition>
Aug 17 16:24:29 user nova-compute[72724]:   </resource>
Aug 17 16:24:29 user nova-compute[72724]:   <sysinfo type='smbios'>
Aug 17 16:24:29 user nova-compute[72724]:     <system>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='version'>0.0.0</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='serial'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='uuid'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='family'>Virtual Machine</entry>
Aug 17 16:24:29 user nova-compute[72724]:     </system>
Aug 17 16:24:29 user nova-compute[72724]:   </sysinfo>
Aug 17 16:24:29 user nova-compute[72724]:   <os>
Aug 17 16:24:29 user nova-compute[72724]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 16:24:29 user nova-compute[72724]:     <boot dev='hd'/>
Aug 17 16:24:29 user nova-compute[72724]:     <smbios mode='sysinfo'/>
Aug 17 16:24:29 user nova-compute[72724]:   </os>
Aug 17 16:24:29 user nova-compute[72724]:   <features>
Aug 17 16:24:29 user nova-compute[72724]:     <acpi/>
Aug 17 16:24:29 user nova-compute[72724]:     <apic/>
Aug 17 16:24:29 user nova-compute[72724]:     <vmcoreinfo state='on'/>
Aug 17 16:24:29 user nova-compute[72724]:   </features>
Aug 17 16:24:29 user nova-compute[72724]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 16:24:29 user nova-compute[72724]:     <model fallback='forbid'>Nehalem</model>
Aug 17 16:24:29 user nova-compute[72724]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='vme'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='x2apic'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='hypervisor'/>
Aug 17 16:24:29 user nova-compute[72724]:   </cpu>
Aug 17 16:24:29 user nova-compute[72724]:   <clock offset='utc'>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='hpet' present='no'/>
Aug 17 16:24:29 user nova-compute[72724]:   </clock>
Aug 17 16:24:29 user nova-compute[72724]:   <on_poweroff>destroy</on_poweroff>
Aug 17 16:24:29 user nova-compute[72724]:   <on_reboot>restart</on_reboot>
Aug 17 16:24:29 user nova-compute[72724]:   <on_crash>destroy</on_crash>
Aug 17 16:24:29 user nova-compute[72724]:   <devices>
Aug 17 16:24:29 user nova-compute[72724]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 16:24:29 user nova-compute[72724]:     <disk type='file' device='disk'>
Aug 17 16:24:29 user nova-compute[72724]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 16:24:29 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk' index='2'/>
Aug 17 16:24:29 user nova-compute[72724]:       <backingStore type='file' index='3'>
Aug 17 16:24:29 user nova-compute[72724]:         <format type='raw'/>
Aug 17 16:24:29 user nova-compute[72724]:         <source file='/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b'/>
Aug 17 16:24:29 user nova-compute[72724]:         <backingStore/>
Aug 17 16:24:29 user nova-compute[72724]:       </backingStore>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='vda' bus='virtio'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='virtio-disk0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </disk>
Aug 17 16:24:29 user nova-compute[72724]:     <disk type='file' device='cdrom'>
Aug 17 16:24:29 user nova-compute[72724]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 16:24:29 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config' index='1'/>
Aug 17 16:24:29 user nova-compute[72724]:       <backingStore/>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='hda' bus='ide'/>
Aug 17 16:24:29 user nova-compute[72724]:       <readonly/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='ide0-0-0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </disk>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='usb' index='0' model='none'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='usb'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='pci.0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='ide' index='0'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='ide'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <interface type='ethernet'>
Aug 17 16:24:29 user nova-compute[72724]:       <mac address='fa:16:3e:31:be:0a'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='tap5a7d507b-63'/>
Aug 17 16:24:29 user nova-compute[72724]:       <model type='virtio'/>
Aug 17 16:24:29 user nova-compute[72724]:       <mtu size='1442'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='net0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </interface>
Aug 17 16:24:29 user nova-compute[72724]:     <serial type='pty'>
Aug 17 16:24:29 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:29 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target type='isa-serial' port='0'>
Aug 17 16:24:29 user nova-compute[72724]:         <model name='isa-serial'/>
Aug 17 16:24:29 user nova-compute[72724]:       </target>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </serial>
Aug 17 16:24:29 user nova-compute[72724]:     <console type='pty' tty='/dev/pts/6'>
Aug 17 16:24:29 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:29 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target type='serial' port='0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </console>
Aug 17 16:24:29 user nova-compute[72724]:     <input type='mouse' bus='ps2'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='input0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </input>
Aug 17 16:24:29 user nova-compute[72724]:     <input type='keyboard' bus='ps2'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='input1'/>
Aug 17 16:24:29 user nova-compute[72724]:     </input>
Aug 17 16:24:29 user nova-compute[72724]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 17 16:24:29 user nova-compute[72724]:       <listen type='address' address='0.0.0.0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </graphics>
Aug 17 16:24:29 user nova-compute[72724]:     <audio id='1' type='none'/>
Aug 17 16:24:29 user nova-compute[72724]:     <video>
Aug 17 16:24:29 user nova-compute[72724]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='video0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </video>
Aug 17 16:24:29 user nova-compute[72724]:     <memballoon model='virtio'>
Aug 17 16:24:29 user nova-compute[72724]:       <stats period='10'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='balloon0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </memballoon>
Aug 17 16:24:29 user nova-compute[72724]:     <rng model='virtio'>
Aug 17 16:24:29 user nova-compute[72724]:       <backend model='random'>/dev/urandom</backend>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='rng0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </rng>
Aug 17 16:24:29 user nova-compute[72724]:   </devices>
Aug 17 16:24:29 user nova-compute[72724]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 16:24:29 user nova-compute[72724]:     <label>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</label>
Aug 17 16:24:29 user nova-compute[72724]:     <imagelabel>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</imagelabel>
Aug 17 16:24:29 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:29 user nova-compute[72724]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 16:24:29 user nova-compute[72724]:     <label>+64055:+108</label>
Aug 17 16:24:29 user nova-compute[72724]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 16:24:29 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:29 user nova-compute[72724]: </domain>
Aug 17 16:24:29 user nova-compute[72724]:  {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 16:24:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully detached device tap7164611e-41 from instance f3f221f6-da33-46ff-be72-aadc05e46d8a from the live domain config.
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG os_vif [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7164611e-41, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: INFO os_vif [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41')
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:29 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:29</nova:creationTime>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:29 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:29 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:29 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:29 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:29 user nova-compute[72724]:  {{(pid=72724) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-71a4d14c-84ca-445e-946a-5f5515c992a0 req-298878ee-8e53-4e79-9358-9bddcba52234 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-unplugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-71a4d14c-84ca-445e-946a-5f5515c992a0 req-298878ee-8e53-4e79-9358-9bddcba52234 service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-71a4d14c-84ca-445e-946a-5f5515c992a0 req-298878ee-8e53-4e79-9358-9bddcba52234 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-71a4d14c-84ca-445e-946a-5f5515c992a0 req-298878ee-8e53-4e79-9358-9bddcba52234 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-71a4d14c-84ca-445e-946a-5f5515c992a0 req-298878ee-8e53-4e79-9358-9bddcba52234 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-unplugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:29 user nova-compute[72724]: WARNING nova.compute.manager [req-71a4d14c-84ca-445e-946a-5f5515c992a0 req-298878ee-8e53-4e79-9358-9bddcba52234 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-unplugged-7164611e-4161-423a-a30c-365ae12bae04 for instance with vm_state active and task_state None.
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-deleted-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:29 user nova-compute[72724]: INFO nova.compute.manager [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Neutron deleted interface 7164611e-4161-423a-a30c-365ae12bae04; detaching it from the instance and deleting it from the info cache
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.neutron [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquired lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.objects.instance [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Lazy-loading 'system_metadata' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.objects.instance [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Lazy-loading 'flavor' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Converting VIF {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface> {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 17 16:24:29 user nova-compute[72724]:   <name>instance-00000007</name>
Aug 17 16:24:29 user nova-compute[72724]:   <uuid>f3f221f6-da33-46ff-be72-aadc05e46d8a</uuid>
Aug 17 16:24:29 user nova-compute[72724]:   <metadata>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:29 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:29</nova:creationTime>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:29 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:29 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:29 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:29 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:29 user nova-compute[72724]:   </metadata>
Aug 17 16:24:29 user nova-compute[72724]:   <memory unit='KiB'>524288</memory>
Aug 17 16:24:29 user nova-compute[72724]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 16:24:29 user nova-compute[72724]:   <vcpu placement='static'>1</vcpu>
Aug 17 16:24:29 user nova-compute[72724]:   <resource>
Aug 17 16:24:29 user nova-compute[72724]:     <partition>/machine</partition>
Aug 17 16:24:29 user nova-compute[72724]:   </resource>
Aug 17 16:24:29 user nova-compute[72724]:   <sysinfo type='smbios'>
Aug 17 16:24:29 user nova-compute[72724]:     <system>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='version'>0.0.0</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='serial'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='uuid'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='family'>Virtual Machine</entry>
Aug 17 16:24:29 user nova-compute[72724]:     </system>
Aug 17 16:24:29 user nova-compute[72724]:   </sysinfo>
Aug 17 16:24:29 user nova-compute[72724]:   <os>
Aug 17 16:24:29 user nova-compute[72724]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 16:24:29 user nova-compute[72724]:     <boot dev='hd'/>
Aug 17 16:24:29 user nova-compute[72724]:     <smbios mode='sysinfo'/>
Aug 17 16:24:29 user nova-compute[72724]:   </os>
Aug 17 16:24:29 user nova-compute[72724]:   <features>
Aug 17 16:24:29 user nova-compute[72724]:     <acpi/>
Aug 17 16:24:29 user nova-compute[72724]:     <apic/>
Aug 17 16:24:29 user nova-compute[72724]:     <vmcoreinfo state='on'/>
Aug 17 16:24:29 user nova-compute[72724]:   </features>
Aug 17 16:24:29 user nova-compute[72724]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 16:24:29 user nova-compute[72724]:     <model fallback='forbid'>Nehalem</model>
Aug 17 16:24:29 user nova-compute[72724]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='vme'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='x2apic'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='hypervisor'/>
Aug 17 16:24:29 user nova-compute[72724]:   </cpu>
Aug 17 16:24:29 user nova-compute[72724]:   <clock offset='utc'>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='hpet' present='no'/>
Aug 17 16:24:29 user nova-compute[72724]:   </clock>
Aug 17 16:24:29 user nova-compute[72724]:   <on_poweroff>destroy</on_poweroff>
Aug 17 16:24:29 user nova-compute[72724]:   <on_reboot>restart</on_reboot>
Aug 17 16:24:29 user nova-compute[72724]:   <on_crash>destroy</on_crash>
Aug 17 16:24:29 user nova-compute[72724]:   <devices>
Aug 17 16:24:29 user nova-compute[72724]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 16:24:29 user nova-compute[72724]:     <disk type='file' device='disk'>
Aug 17 16:24:29 user nova-compute[72724]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 16:24:29 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk' index='2'/>
Aug 17 16:24:29 user nova-compute[72724]:       <backingStore type='file' index='3'>
Aug 17 16:24:29 user nova-compute[72724]:         <format type='raw'/>
Aug 17 16:24:29 user nova-compute[72724]:         <source file='/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b'/>
Aug 17 16:24:29 user nova-compute[72724]:         <backingStore/>
Aug 17 16:24:29 user nova-compute[72724]:       </backingStore>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='vda' bus='virtio'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='virtio-disk0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </disk>
Aug 17 16:24:29 user nova-compute[72724]:     <disk type='file' device='cdrom'>
Aug 17 16:24:29 user nova-compute[72724]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 16:24:29 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config' index='1'/>
Aug 17 16:24:29 user nova-compute[72724]:       <backingStore/>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='hda' bus='ide'/>
Aug 17 16:24:29 user nova-compute[72724]:       <readonly/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='ide0-0-0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </disk>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='usb' index='0' model='none'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='usb'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='pci.0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='ide' index='0'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='ide'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <interface type='ethernet'>
Aug 17 16:24:29 user nova-compute[72724]:       <mac address='fa:16:3e:31:be:0a'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='tap5a7d507b-63'/>
Aug 17 16:24:29 user nova-compute[72724]:       <model type='virtio'/>
Aug 17 16:24:29 user nova-compute[72724]:       <mtu size='1442'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='net0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </interface>
Aug 17 16:24:29 user nova-compute[72724]:     <serial type='pty'>
Aug 17 16:24:29 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:29 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target type='isa-serial' port='0'>
Aug 17 16:24:29 user nova-compute[72724]:         <model name='isa-serial'/>
Aug 17 16:24:29 user nova-compute[72724]:       </target>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </serial>
Aug 17 16:24:29 user nova-compute[72724]:     <console type='pty' tty='/dev/pts/6'>
Aug 17 16:24:29 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:29 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target type='serial' port='0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </console>
Aug 17 16:24:29 user nova-compute[72724]:     <input type='mouse' bus='ps2'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='input0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </input>
Aug 17 16:24:29 user nova-compute[72724]:     <input type='keyboard' bus='ps2'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='input1'/>
Aug 17 16:24:29 user nova-compute[72724]:     </input>
Aug 17 16:24:29 user nova-compute[72724]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 17 16:24:29 user nova-compute[72724]:       <listen type='address' address='0.0.0.0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </graphics>
Aug 17 16:24:29 user nova-compute[72724]:     <audio id='1' type='none'/>
Aug 17 16:24:29 user nova-compute[72724]:     <video>
Aug 17 16:24:29 user nova-compute[72724]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='video0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </video>
Aug 17 16:24:29 user nova-compute[72724]:     <memballoon model='virtio'>
Aug 17 16:24:29 user nova-compute[72724]:       <stats period='10'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='balloon0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </memballoon>
Aug 17 16:24:29 user nova-compute[72724]:     <rng model='virtio'>
Aug 17 16:24:29 user nova-compute[72724]:       <backend model='random'>/dev/urandom</backend>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='rng0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </rng>
Aug 17 16:24:29 user nova-compute[72724]:   </devices>
Aug 17 16:24:29 user nova-compute[72724]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 16:24:29 user nova-compute[72724]:     <label>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</label>
Aug 17 16:24:29 user nova-compute[72724]:     <imagelabel>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</imagelabel>
Aug 17 16:24:29 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:29 user nova-compute[72724]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 16:24:29 user nova-compute[72724]:     <label>+64055:+108</label>
Aug 17 16:24:29 user nova-compute[72724]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 16:24:29 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:29 user nova-compute[72724]: </domain>
Aug 17 16:24:29 user nova-compute[72724]:  {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface> {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:48:d4:59"/><model type="virtio"/><mtu size="1442"/><target dev="tap7164611e-41"/></interface>not found in domain: <domain type='kvm' id='7'>
Aug 17 16:24:29 user nova-compute[72724]:   <name>instance-00000007</name>
Aug 17 16:24:29 user nova-compute[72724]:   <uuid>f3f221f6-da33-46ff-be72-aadc05e46d8a</uuid>
Aug 17 16:24:29 user nova-compute[72724]:   <metadata>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:29 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:29</nova:creationTime>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:29 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:29 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:29 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:29 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:29 user nova-compute[72724]:   </metadata>
Aug 17 16:24:29 user nova-compute[72724]:   <memory unit='KiB'>524288</memory>
Aug 17 16:24:29 user nova-compute[72724]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 17 16:24:29 user nova-compute[72724]:   <vcpu placement='static'>1</vcpu>
Aug 17 16:24:29 user nova-compute[72724]:   <resource>
Aug 17 16:24:29 user nova-compute[72724]:     <partition>/machine</partition>
Aug 17 16:24:29 user nova-compute[72724]:   </resource>
Aug 17 16:24:29 user nova-compute[72724]:   <sysinfo type='smbios'>
Aug 17 16:24:29 user nova-compute[72724]:     <system>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='product'>OpenStack Nova</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='version'>0.0.0</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='serial'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='uuid'>f3f221f6-da33-46ff-be72-aadc05e46d8a</entry>
Aug 17 16:24:29 user nova-compute[72724]:       <entry name='family'>Virtual Machine</entry>
Aug 17 16:24:29 user nova-compute[72724]:     </system>
Aug 17 16:24:29 user nova-compute[72724]:   </sysinfo>
Aug 17 16:24:29 user nova-compute[72724]:   <os>
Aug 17 16:24:29 user nova-compute[72724]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 17 16:24:29 user nova-compute[72724]:     <boot dev='hd'/>
Aug 17 16:24:29 user nova-compute[72724]:     <smbios mode='sysinfo'/>
Aug 17 16:24:29 user nova-compute[72724]:   </os>
Aug 17 16:24:29 user nova-compute[72724]:   <features>
Aug 17 16:24:29 user nova-compute[72724]:     <acpi/>
Aug 17 16:24:29 user nova-compute[72724]:     <apic/>
Aug 17 16:24:29 user nova-compute[72724]:     <vmcoreinfo state='on'/>
Aug 17 16:24:29 user nova-compute[72724]:   </features>
Aug 17 16:24:29 user nova-compute[72724]:   <cpu mode='custom' match='exact' check='full'>
Aug 17 16:24:29 user nova-compute[72724]:     <model fallback='forbid'>Nehalem</model>
Aug 17 16:24:29 user nova-compute[72724]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='vme'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='x2apic'/>
Aug 17 16:24:29 user nova-compute[72724]:     <feature policy='require' name='hypervisor'/>
Aug 17 16:24:29 user nova-compute[72724]:   </cpu>
Aug 17 16:24:29 user nova-compute[72724]:   <clock offset='utc'>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='pit' tickpolicy='delay'/>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 17 16:24:29 user nova-compute[72724]:     <timer name='hpet' present='no'/>
Aug 17 16:24:29 user nova-compute[72724]:   </clock>
Aug 17 16:24:29 user nova-compute[72724]:   <on_poweroff>destroy</on_poweroff>
Aug 17 16:24:29 user nova-compute[72724]:   <on_reboot>restart</on_reboot>
Aug 17 16:24:29 user nova-compute[72724]:   <on_crash>destroy</on_crash>
Aug 17 16:24:29 user nova-compute[72724]:   <devices>
Aug 17 16:24:29 user nova-compute[72724]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 17 16:24:29 user nova-compute[72724]:     <disk type='file' device='disk'>
Aug 17 16:24:29 user nova-compute[72724]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 17 16:24:29 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk' index='2'/>
Aug 17 16:24:29 user nova-compute[72724]:       <backingStore type='file' index='3'>
Aug 17 16:24:29 user nova-compute[72724]:         <format type='raw'/>
Aug 17 16:24:29 user nova-compute[72724]:         <source file='/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b'/>
Aug 17 16:24:29 user nova-compute[72724]:         <backingStore/>
Aug 17 16:24:29 user nova-compute[72724]:       </backingStore>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='vda' bus='virtio'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='virtio-disk0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </disk>
Aug 17 16:24:29 user nova-compute[72724]:     <disk type='file' device='cdrom'>
Aug 17 16:24:29 user nova-compute[72724]:       <driver name='qemu' type='raw' cache='none'/>
Aug 17 16:24:29 user nova-compute[72724]:       <source file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk.config' index='1'/>
Aug 17 16:24:29 user nova-compute[72724]:       <backingStore/>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='hda' bus='ide'/>
Aug 17 16:24:29 user nova-compute[72724]:       <readonly/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='ide0-0-0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </disk>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='usb' index='0' model='none'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='usb'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='pci' index='0' model='pci-root'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='pci.0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <controller type='ide' index='0'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='ide'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 17 16:24:29 user nova-compute[72724]:     </controller>
Aug 17 16:24:29 user nova-compute[72724]:     <interface type='ethernet'>
Aug 17 16:24:29 user nova-compute[72724]:       <mac address='fa:16:3e:31:be:0a'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target dev='tap5a7d507b-63'/>
Aug 17 16:24:29 user nova-compute[72724]:       <model type='virtio'/>
Aug 17 16:24:29 user nova-compute[72724]:       <mtu size='1442'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='net0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </interface>
Aug 17 16:24:29 user nova-compute[72724]:     <serial type='pty'>
Aug 17 16:24:29 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:29 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target type='isa-serial' port='0'>
Aug 17 16:24:29 user nova-compute[72724]:         <model name='isa-serial'/>
Aug 17 16:24:29 user nova-compute[72724]:       </target>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </serial>
Aug 17 16:24:29 user nova-compute[72724]:     <console type='pty' tty='/dev/pts/6'>
Aug 17 16:24:29 user nova-compute[72724]:       <source path='/dev/pts/6'/>
Aug 17 16:24:29 user nova-compute[72724]:       <log file='/opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/console.log' append='off'/>
Aug 17 16:24:29 user nova-compute[72724]:       <target type='serial' port='0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='serial0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </console>
Aug 17 16:24:29 user nova-compute[72724]:     <input type='mouse' bus='ps2'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='input0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </input>
Aug 17 16:24:29 user nova-compute[72724]:     <input type='keyboard' bus='ps2'>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='input1'/>
Aug 17 16:24:29 user nova-compute[72724]:     </input>
Aug 17 16:24:29 user nova-compute[72724]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Aug 17 16:24:29 user nova-compute[72724]:       <listen type='address' address='0.0.0.0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </graphics>
Aug 17 16:24:29 user nova-compute[72724]:     <audio id='1' type='none'/>
Aug 17 16:24:29 user nova-compute[72724]:     <video>
Aug 17 16:24:29 user nova-compute[72724]:       <model type='virtio' heads='1' primary='yes'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='video0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </video>
Aug 17 16:24:29 user nova-compute[72724]:     <memballoon model='virtio'>
Aug 17 16:24:29 user nova-compute[72724]:       <stats period='10'/>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='balloon0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </memballoon>
Aug 17 16:24:29 user nova-compute[72724]:     <rng model='virtio'>
Aug 17 16:24:29 user nova-compute[72724]:       <backend model='random'>/dev/urandom</backend>
Aug 17 16:24:29 user nova-compute[72724]:       <alias name='rng0'/>
Aug 17 16:24:29 user nova-compute[72724]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 17 16:24:29 user nova-compute[72724]:     </rng>
Aug 17 16:24:29 user nova-compute[72724]:   </devices>
Aug 17 16:24:29 user nova-compute[72724]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 17 16:24:29 user nova-compute[72724]:     <label>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</label>
Aug 17 16:24:29 user nova-compute[72724]:     <imagelabel>libvirt-f3f221f6-da33-46ff-be72-aadc05e46d8a</imagelabel>
Aug 17 16:24:29 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:29 user nova-compute[72724]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 17 16:24:29 user nova-compute[72724]:     <label>+64055:+108</label>
Aug 17 16:24:29 user nova-compute[72724]:     <imagelabel>+64055:+108</imagelabel>
Aug 17 16:24:29 user nova-compute[72724]:   </seclabel>
Aug 17 16:24:29 user nova-compute[72724]: </domain>
Aug 17 16:24:29 user nova-compute[72724]:  {{(pid=72724) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 17 16:24:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Detaching interface fa:16:3e:48:d4:59 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap7164611e-41' not found.
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Converting VIF {"id": "7164611e-4161-423a-a30c-365ae12bae04", "address": "fa:16:3e:48:d4:59", "network": {"id": "6a234bcf-897a-4c85-bd91-95f2493cdaf8", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-648923129", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.169", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7164611e-41", "ovs_interfaceid": "7164611e-4161-423a-a30c-365ae12bae04", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG os_vif [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7164611e-41, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:24:29 user nova-compute[72724]: INFO os_vif [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d4:59,bridge_name='br-int',has_traffic_filtering=True,id=7164611e-4161-423a-a30c-365ae12bae04,network=Network(6a234bcf-897a-4c85-bd91-95f2493cdaf8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7164611e-41')
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [req-abc362b2-7262-4eeb-82cc-3cb8a4b4af6e req-5e10e904-f391-4c43-9385-dafba2a14874 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:29 user nova-compute[72724]:   <nova:package version="0.0.0"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:name>tempest-device-tagging-server-1665195797</nova:name>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:creationTime>2023-08-17 16:24:29</nova:creationTime>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:flavor name="m1.tiny">
Aug 17 16:24:29 user nova-compute[72724]:     <nova:memory>512</nova:memory>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:disk>1</nova:disk>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:swap>0</nova:swap>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:flavor>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:user uuid="9e1309addf494df99a5a660510c89a01">tempest-TaggedAttachmentsTest-530973025-project-member</nova:user>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:project uuid="1423d90110e74cd5aef429873bd098ee">tempest-TaggedAttachmentsTest-530973025</nova:project>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:owner>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:29 user nova-compute[72724]:   <nova:ports>
Aug 17 16:24:29 user nova-compute[72724]:     <nova:port uuid="5a7d507b-63c6-47b2-9e30-c37f05e03f1e">
Aug 17 16:24:29 user nova-compute[72724]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:24:29 user nova-compute[72724]:     </nova:port>
Aug 17 16:24:29 user nova-compute[72724]:   </nova:ports>
Aug 17 16:24:29 user nova-compute[72724]: </nova:instance>
Aug 17 16:24:29 user nova-compute[72724]:  {{(pid=72724) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Skipping network cache update for instance because it has been migrated to another host. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [{"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Releasing lock "refresh_cache-f3f221f6-da33-46ff-be72-aadc05e46d8a" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa8951f9-7b4e-4e13-bc4f-3158f0367978 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "interface-f3f221f6-da33-46ff-be72-aadc05e46d8a-7164611e-4161-423a-a30c-365ae12bae04" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.320s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updating instance_info_cache with network_info: [{"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:24:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-5379bc8d-3d08-4d21-ba40-1866b15447fb req-62f4892c-09f5-4987-84a7-c0a3a8ab0762 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5379bc8d-3d08-4d21-ba40-1866b15447fb req-62f4892c-09f5-4987-84a7-c0a3a8ab0762 service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5379bc8d-3d08-4d21-ba40-1866b15447fb req-62f4892c-09f5-4987-84a7-c0a3a8ab0762 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5379bc8d-3d08-4d21-ba40-1866b15447fb req-62f4892c-09f5-4987-84a7-c0a3a8ab0762 service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-5379bc8d-3d08-4d21-ba40-1866b15447fb req-62f4892c-09f5-4987-84a7-c0a3a8ab0762 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:31 user nova-compute[72724]: WARNING nova.compute.manager [req-5379bc8d-3d08-4d21-ba40-1866b15447fb req-62f4892c-09f5-4987-84a7-c0a3a8ab0762 service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-plugged-7164611e-4161-423a-a30c-365ae12bae04 for instance with vm_state active and task_state None.
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:24:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:32 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:24:32 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7909MB free_disk=25.828121185302734GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 75fd7469-8155-43cf-a93c-fac4132c8f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f3f221f6-da33-46ff-be72-aadc05e46d8a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance de3f1276-aa06-4843-a69a-165a7c624f8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:24:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:24:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:24:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:24:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:24:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.332s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:33 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289458.6423895, 496b7bc3-5cfc-478b-b1f4-fbfd59426852 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:24:33 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] VM Stopped (Lifecycle Event)
Aug 17 16:24:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2456f102-8795-4328-8a49-eee2c75fe0c2 None None] [instance: 496b7bc3-5cfc-478b-b1f4-fbfd59426852] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:24:52 user nova-compute[72724]: INFO nova.compute.claims [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Claim successful on node user
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.309s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.network.neutron [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:24:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:24:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.policy [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd44441d94d244ec5a0e0b00617a3229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4518061f274934833bc6801498ec91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:24:53 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Creating image(s)
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "/opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "/opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.167s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk 1073741824" returned: 0 in 0.047s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.network.neutron [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Successfully created port: 605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Cannot resize image /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.objects.instance [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'migration_context' on Instance uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Ensure instance console log exists: /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Successfully updated port: 605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-changed-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Refreshing instance network info cache due to event network-changed-605f0625-4ba6-4c19-8562-47d6de868f1b. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:24:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Instance network_info: |[{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Refreshing network info cache for port 605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Start _get_guest_xml network_info=[{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:24:55 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:24:55 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-299344490',display_name='tempest-ServerActionsTestOtherA-server-299344490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-299344490',id=10,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-n6z7kj0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=a0f11a53-3d01-4ad5-bc55-5df42490f7f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.objects.instance [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_devices' on Instance uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:24:55 user nova-compute[72724]:   <uuid>a0f11a53-3d01-4ad5-bc55-5df42490f7f2</uuid>
Aug 17 16:24:55 user nova-compute[72724]:   <name>instance-0000000a</name>
Aug 17 16:24:55 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:24:55 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:24:55 user nova-compute[72724]:   <metadata>
Aug 17 16:24:55 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:24:55 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:24:55 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherA-server-299344490</nova:name>
Aug 17 16:24:55 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:24:55</nova:creationTime>
Aug 17 16:24:55 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:24:55 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:24:55 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:24:55 user nova-compute[72724]:       <nova:owner>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:user uuid="d44441d94d244ec5a0e0b00617a3229f">tempest-ServerActionsTestOtherA-2020786536-project-member</nova:user>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:project uuid="6f4518061f274934833bc6801498ec91">tempest-ServerActionsTestOtherA-2020786536</nova:project>
Aug 17 16:24:55 user nova-compute[72724]:       </nova:owner>
Aug 17 16:24:55 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:24:55 user nova-compute[72724]:       <nova:ports>
Aug 17 16:24:55 user nova-compute[72724]:         <nova:port uuid="605f0625-4ba6-4c19-8562-47d6de868f1b">
Aug 17 16:24:55 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 16:24:55 user nova-compute[72724]:         </nova:port>
Aug 17 16:24:55 user nova-compute[72724]:       </nova:ports>
Aug 17 16:24:55 user nova-compute[72724]:     </nova:instance>
Aug 17 16:24:55 user nova-compute[72724]:   </metadata>
Aug 17 16:24:55 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:24:55 user nova-compute[72724]:     <system>
Aug 17 16:24:55 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:24:55 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:24:55 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:24:55 user nova-compute[72724]:       <entry name="serial">a0f11a53-3d01-4ad5-bc55-5df42490f7f2</entry>
Aug 17 16:24:55 user nova-compute[72724]:       <entry name="uuid">a0f11a53-3d01-4ad5-bc55-5df42490f7f2</entry>
Aug 17 16:24:55 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:24:55 user nova-compute[72724]:     </system>
Aug 17 16:24:55 user nova-compute[72724]:   </sysinfo>
Aug 17 16:24:55 user nova-compute[72724]:   <os>
Aug 17 16:24:55 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:24:55 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:24:55 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:24:55 user nova-compute[72724]:   </os>
Aug 17 16:24:55 user nova-compute[72724]:   <features>
Aug 17 16:24:55 user nova-compute[72724]:     <acpi/>
Aug 17 16:24:55 user nova-compute[72724]:     <apic/>
Aug 17 16:24:55 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:24:55 user nova-compute[72724]:   </features>
Aug 17 16:24:55 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:24:55 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:24:55 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:24:55 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:24:55 user nova-compute[72724]:   </clock>
Aug 17 16:24:55 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:24:55 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:24:55 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:24:55 user nova-compute[72724]:   </cpu>
Aug 17 16:24:55 user nova-compute[72724]:   <devices>
Aug 17 16:24:55 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:24:55 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:24:55 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk"/>
Aug 17 16:24:55 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:24:55 user nova-compute[72724]:     </disk>
Aug 17 16:24:55 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:24:55 user nova-compute[72724]:       <mac address="fa:16:3e:ad:09:06"/>
Aug 17 16:24:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:24:55 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:24:55 user nova-compute[72724]:       <target dev="tap605f0625-4b"/>
Aug 17 16:24:55 user nova-compute[72724]:     </interface>
Aug 17 16:24:55 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:24:55 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/console.log" append="off"/>
Aug 17 16:24:55 user nova-compute[72724]:     </serial>
Aug 17 16:24:55 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:24:55 user nova-compute[72724]:     <video>
Aug 17 16:24:55 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:24:55 user nova-compute[72724]:     </video>
Aug 17 16:24:55 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:24:55 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:24:55 user nova-compute[72724]:     </rng>
Aug 17 16:24:55 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:24:55 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:24:55 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:24:55 user nova-compute[72724]:     </memballoon>
Aug 17 16:24:55 user nova-compute[72724]:   </devices>
Aug 17 16:24:55 user nova-compute[72724]: </domain>
Aug 17 16:24:55 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-299344490',display_name='tempest-ServerActionsTestOtherA-server-299344490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-299344490',id=10,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-n6z7kj0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:24:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=a0f11a53-3d01-4ad5-bc55-5df42490f7f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG os_vif [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap605f0625-4b, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap605f0625-4b, col_values=(('external_ids', {'iface-id': '605f0625-4ba6-4c19-8562-47d6de868f1b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:09:06', 'vm-uuid': 'a0f11a53-3d01-4ad5-bc55-5df42490f7f2'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:55 user nova-compute[72724]: INFO os_vif [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b')
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No VIF found with MAC fa:16:3e:ad:09:06, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updated VIF entry in instance network info cache for port 605f0625-4ba6-4c19-8562-47d6de868f1b. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d82720c6-8944-46af-8d2d-c5f4d3e6a702 req-75b013a8-f09c-45b7-9499-ff3c69fb78c9 service nova] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:24:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-900f5ba0-e627-4fe2-8118-49c754733d91 req-f2c36f80-1390-4b3c-b189-efbfb4d15385 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-900f5ba0-e627-4fe2-8118-49c754733d91 req-f2c36f80-1390-4b3c-b189-efbfb4d15385 service nova] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-900f5ba0-e627-4fe2-8118-49c754733d91 req-f2c36f80-1390-4b3c-b189-efbfb4d15385 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-900f5ba0-e627-4fe2-8118-49c754733d91 req-f2c36f80-1390-4b3c-b189-efbfb4d15385 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-900f5ba0-e627-4fe2-8118-49c754733d91 req-f2c36f80-1390-4b3c-b189-efbfb4d15385 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] No waiting events found dispatching network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:56 user nova-compute[72724]: WARNING nova.compute.manager [req-900f5ba0-e627-4fe2-8118-49c754733d91 req-f2c36f80-1390-4b3c-b189-efbfb4d15385 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received unexpected event network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b for instance with vm_state building and task_state spawning.
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289498.4993877, a0f11a53-3d01-4ad5-bc55-5df42490f7f2 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] VM Resumed (Lifecycle Event)
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Instance spawned successfully.
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289498.5009809, a0f11a53-3d01-4ad5-bc55-5df42490f7f2 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] VM Started (Lifecycle Event)
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Took 5.56 seconds to spawn the instance on the hypervisor.
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-e8fe4651-82b2-4cec-b210-de8ba1332a4e req-926a4a0f-9f40-42ea-99a2-1265c9dd1364 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e8fe4651-82b2-4cec-b210-de8ba1332a4e req-926a4a0f-9f40-42ea-99a2-1265c9dd1364 service nova] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e8fe4651-82b2-4cec-b210-de8ba1332a4e req-926a4a0f-9f40-42ea-99a2-1265c9dd1364 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e8fe4651-82b2-4cec-b210-de8ba1332a4e req-926a4a0f-9f40-42ea-99a2-1265c9dd1364 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:24:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-e8fe4651-82b2-4cec-b210-de8ba1332a4e req-926a4a0f-9f40-42ea-99a2-1265c9dd1364 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] No waiting events found dispatching network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:24:58 user nova-compute[72724]: WARNING nova.compute.manager [req-e8fe4651-82b2-4cec-b210-de8ba1332a4e req-926a4a0f-9f40-42ea-99a2-1265c9dd1364 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received unexpected event network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b for instance with vm_state building and task_state spawning.
Aug 17 16:24:58 user nova-compute[72724]: INFO nova.compute.manager [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Took 6.18 seconds to build instance.
Aug 17 16:24:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-57851cee-fd2c-425a-9f95-a237639a0b39 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.272s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "621f2153-b6a5-4697-868b-39681372ff2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:11 user nova-compute[72724]: INFO nova.compute.manager [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Terminating instance
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:25:11 user nova-compute[72724]: INFO nova.compute.claims [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Claim successful on node user
Aug 17 16:25:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-c261d3cb-3754-4db6-9911-77d1dccee6b5 req-1031d703-90f0-4dcb-8dd1-69922ebfc8a9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-vif-unplugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c261d3cb-3754-4db6-9911-77d1dccee6b5 req-1031d703-90f0-4dcb-8dd1-69922ebfc8a9 service nova] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c261d3cb-3754-4db6-9911-77d1dccee6b5 req-1031d703-90f0-4dcb-8dd1-69922ebfc8a9 service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c261d3cb-3754-4db6-9911-77d1dccee6b5 req-1031d703-90f0-4dcb-8dd1-69922ebfc8a9 service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-c261d3cb-3754-4db6-9911-77d1dccee6b5 req-1031d703-90f0-4dcb-8dd1-69922ebfc8a9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] No waiting events found dispatching network-vif-unplugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-c261d3cb-3754-4db6-9911-77d1dccee6b5 req-1031d703-90f0-4dcb-8dd1-69922ebfc8a9 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-vif-unplugged-c6bf9a65-57d5-434e-9245-52872517116f for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.510s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:25:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.policy [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c77204386d84a2181e58358f1ade5a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbe523fb48904a97a8b02bbe415b6794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:25:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Creating image(s)
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "/opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "/opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "/opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Instance destroyed successfully.
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lazy-loading 'resources' on Instance uuid a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:22:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-837723403',display_name='tempest-VolumesAssistedSnapshotsTest-server-837723403',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-837723403',id=5,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGX/Smn6Eb06SV5VjWvtec1/CVfKjRNEfpuKoLCsPZ703Pzw8YW/xOo0FGFCnq6JMyzIC/vYSVGlG5N4sg5cKsUQePLeyluoywjT74Uo5qsYlOhDtRX392oeCqX1LG92/A==',key_name='tempest-keypair-123596867',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1da4234e05d640a0810a70a4f5d00dc9',ramdisk_id='',reservation_id='r-ergd81d7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1150961592',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1150961592-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='884bfb7eb9834776bf2229d859cb064a',uuid=a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Converting VIF {"id": "c6bf9a65-57d5-434e-9245-52872517116f", "address": "fa:16:3e:5e:91:c1", "network": {"id": "4d173921-f292-4ee6-bab9-bd11bab18d04", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-671506603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1da4234e05d640a0810a70a4f5d00dc9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6bf9a65-57", "ovs_interfaceid": "c6bf9a65-57d5-434e-9245-52872517116f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG os_vif [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6bf9a65-57, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:12 user nova-compute[72724]: INFO os_vif [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:91:c1,bridge_name='br-int',has_traffic_filtering=True,id=c6bf9a65-57d5-434e-9245-52872517116f,network=Network(4d173921-f292-4ee6-bab9-bd11bab18d04),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6bf9a65-57')
Aug 17 16:25:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Deleting instance files /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc_del
Aug 17 16:25:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Deletion of /opt/stack/data/nova/instances/a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc_del complete
Aug 17 16:25:12 user nova-compute[72724]: INFO nova.compute.manager [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Took 1.04 seconds to destroy the instance on the hypervisor.
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.257s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk 1073741824" returned: 0 in 0.053s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.230s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Successfully created port: ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Checking if we can resize image /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Cannot resize image /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'migration_context' on Instance uuid 621f2153-b6a5-4697-868b-39681372ff2f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Ensure instance console log exists: /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-cdecef3c-ef05-4c7a-80aa-ef7e561e4562 req-8d6d76b5-fcc9-4521-aabd-b774ea21c655 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cdecef3c-ef05-4c7a-80aa-ef7e561e4562 req-8d6d76b5-fcc9-4521-aabd-b774ea21c655 service nova] Acquiring lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cdecef3c-ef05-4c7a-80aa-ef7e561e4562 req-8d6d76b5-fcc9-4521-aabd-b774ea21c655 service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cdecef3c-ef05-4c7a-80aa-ef7e561e4562 req-8d6d76b5-fcc9-4521-aabd-b774ea21c655 service nova] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-cdecef3c-ef05-4c7a-80aa-ef7e561e4562 req-8d6d76b5-fcc9-4521-aabd-b774ea21c655 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] No waiting events found dispatching network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:13 user nova-compute[72724]: WARNING nova.compute.manager [req-cdecef3c-ef05-4c7a-80aa-ef7e561e4562 req-8d6d76b5-fcc9-4521-aabd-b774ea21c655 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received unexpected event network-vif-plugged-c6bf9a65-57d5-434e-9245-52872517116f for instance with vm_state active and task_state deleting.
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Successfully updated port: ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:25:13 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Took 1.49 seconds to deallocate network for instance.
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "refresh_cache-621f2153-b6a5-4697-868b-39681372ff2f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquired lock "refresh_cache-621f2153-b6a5-4697-868b-39681372ff2f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-changed-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Refreshing instance network info cache due to event network-changed-ed0ef657-76ee-46d3-ba59-e211ffc43690. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] Acquiring lock "refresh_cache-621f2153-b6a5-4697-868b-39681372ff2f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:14 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Deleted allocations for instance a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Updating instance_info_cache with network_info: [{"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Releasing lock "refresh_cache-621f2153-b6a5-4697-868b-39681372ff2f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Instance network_info: |[{"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] Acquired lock "refresh_cache-621f2153-b6a5-4697-868b-39681372ff2f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Refreshing network info cache for port ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Start _get_guest_xml network_info=[{"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:25:14 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:14 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1083593039',display_name='tempest-VolumesAdminNegativeTest-server-1083593039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1083593039',id=11,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe523fb48904a97a8b02bbe415b6794',ramdisk_id='',reservation_id='r-jxqno82g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1491017065',owner_user_name='tempest-VolumesAdminNegativeTest-1491017065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:25:12Z,user_data=None,user_id='6c77204386d84a2181e58358f1ade5a2',uuid=621f2153-b6a5-4697-868b-39681372ff2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converting VIF {"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'pci_devices' on Instance uuid 621f2153-b6a5-4697-868b-39681372ff2f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-56ea244c-a90f-4bff-b2fe-7627acfba52c tempest-VolumesAssistedSnapshotsTest-1150961592 tempest-VolumesAssistedSnapshotsTest-1150961592-project-member] Lock "a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:25:14 user nova-compute[72724]:   <uuid>621f2153-b6a5-4697-868b-39681372ff2f</uuid>
Aug 17 16:25:14 user nova-compute[72724]:   <name>instance-0000000b</name>
Aug 17 16:25:14 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:25:14 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:25:14 user nova-compute[72724]:   <metadata>
Aug 17 16:25:14 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:25:14 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:25:14 user nova-compute[72724]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1083593039</nova:name>
Aug 17 16:25:14 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:25:14</nova:creationTime>
Aug 17 16:25:14 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:25:14 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:25:14 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:25:14 user nova-compute[72724]:       <nova:owner>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:user uuid="6c77204386d84a2181e58358f1ade5a2">tempest-VolumesAdminNegativeTest-1491017065-project-member</nova:user>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:project uuid="dbe523fb48904a97a8b02bbe415b6794">tempest-VolumesAdminNegativeTest-1491017065</nova:project>
Aug 17 16:25:14 user nova-compute[72724]:       </nova:owner>
Aug 17 16:25:14 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:25:14 user nova-compute[72724]:       <nova:ports>
Aug 17 16:25:14 user nova-compute[72724]:         <nova:port uuid="ed0ef657-76ee-46d3-ba59-e211ffc43690">
Aug 17 16:25:14 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:25:14 user nova-compute[72724]:         </nova:port>
Aug 17 16:25:14 user nova-compute[72724]:       </nova:ports>
Aug 17 16:25:14 user nova-compute[72724]:     </nova:instance>
Aug 17 16:25:14 user nova-compute[72724]:   </metadata>
Aug 17 16:25:14 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:25:14 user nova-compute[72724]:     <system>
Aug 17 16:25:14 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:25:14 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:25:14 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:25:14 user nova-compute[72724]:       <entry name="serial">621f2153-b6a5-4697-868b-39681372ff2f</entry>
Aug 17 16:25:14 user nova-compute[72724]:       <entry name="uuid">621f2153-b6a5-4697-868b-39681372ff2f</entry>
Aug 17 16:25:14 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:25:14 user nova-compute[72724]:     </system>
Aug 17 16:25:14 user nova-compute[72724]:   </sysinfo>
Aug 17 16:25:14 user nova-compute[72724]:   <os>
Aug 17 16:25:14 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:25:14 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:25:14 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:25:14 user nova-compute[72724]:   </os>
Aug 17 16:25:14 user nova-compute[72724]:   <features>
Aug 17 16:25:14 user nova-compute[72724]:     <acpi/>
Aug 17 16:25:14 user nova-compute[72724]:     <apic/>
Aug 17 16:25:14 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:25:14 user nova-compute[72724]:   </features>
Aug 17 16:25:14 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:25:14 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:25:14 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:25:14 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:25:14 user nova-compute[72724]:   </clock>
Aug 17 16:25:14 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:25:14 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:25:14 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:25:14 user nova-compute[72724]:   </cpu>
Aug 17 16:25:14 user nova-compute[72724]:   <devices>
Aug 17 16:25:14 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:25:14 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:25:14 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk"/>
Aug 17 16:25:14 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:25:14 user nova-compute[72724]:     </disk>
Aug 17 16:25:14 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:25:14 user nova-compute[72724]:       <mac address="fa:16:3e:81:b4:4a"/>
Aug 17 16:25:14 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:14 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:25:14 user nova-compute[72724]:       <target dev="taped0ef657-76"/>
Aug 17 16:25:14 user nova-compute[72724]:     </interface>
Aug 17 16:25:14 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:25:14 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/console.log" append="off"/>
Aug 17 16:25:14 user nova-compute[72724]:     </serial>
Aug 17 16:25:14 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:25:14 user nova-compute[72724]:     <video>
Aug 17 16:25:14 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:14 user nova-compute[72724]:     </video>
Aug 17 16:25:14 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:25:14 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:25:14 user nova-compute[72724]:     </rng>
Aug 17 16:25:14 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:25:14 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:25:14 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:25:14 user nova-compute[72724]:     </memballoon>
Aug 17 16:25:14 user nova-compute[72724]:   </devices>
Aug 17 16:25:14 user nova-compute[72724]: </domain>
Aug 17 16:25:14 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1083593039',display_name='tempest-VolumesAdminNegativeTest-server-1083593039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1083593039',id=11,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dbe523fb48904a97a8b02bbe415b6794',ramdisk_id='',reservation_id='r-jxqno82g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1491017065',owner_user_name='tempest-VolumesAdminNegativeTest-1491017065-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:25:12Z,user_data=None,user_id='6c77204386d84a2181e58358f1ade5a2',uuid=621f2153-b6a5-4697-868b-39681372ff2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converting VIF {"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG os_vif [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped0ef657-76, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=taped0ef657-76, col_values=(('external_ids', {'iface-id': 'ed0ef657-76ee-46d3-ba59-e211ffc43690', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:b4:4a', 'vm-uuid': '621f2153-b6a5-4697-868b-39681372ff2f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:14 user nova-compute[72724]: INFO os_vif [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76')
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] No VIF found with MAC fa:16:3e:81:b4:4a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Updated VIF entry in instance network info cache for port ed0ef657-76ee-46d3-ba59-e211ffc43690. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Updating instance_info_cache with network_info: [{"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3e09d030-e31d-4fa8-817e-5dc5ee82bf6d req-68a8b2a1-b4a7-4032-9acf-3e6e331a6740 service nova] Releasing lock "refresh_cache-621f2153-b6a5-4697-868b-39681372ff2f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-4e7e142f-098f-4344-9709-39c879c530bf req-71764d8a-7458-4f2c-9296-608a60e82422 service nova] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Received event network-vif-deleted-c6bf9a65-57d5-434e-9245-52872517116f {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f692cf1a-5198-4dae-b77b-c6fc538ed258 req-343e264a-529f-4638-af6a-bd496dd424e6 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f692cf1a-5198-4dae-b77b-c6fc538ed258 req-343e264a-529f-4638-af6a-bd496dd424e6 service nova] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f692cf1a-5198-4dae-b77b-c6fc538ed258 req-343e264a-529f-4638-af6a-bd496dd424e6 service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f692cf1a-5198-4dae-b77b-c6fc538ed258 req-343e264a-529f-4638-af6a-bd496dd424e6 service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f692cf1a-5198-4dae-b77b-c6fc538ed258 req-343e264a-529f-4638-af6a-bd496dd424e6 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] No waiting events found dispatching network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:15 user nova-compute[72724]: WARNING nova.compute.manager [req-f692cf1a-5198-4dae-b77b-c6fc538ed258 req-343e264a-529f-4638-af6a-bd496dd424e6 service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received unexpected event network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 for instance with vm_state building and task_state spawning.
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289517.7529526, 621f2153-b6a5-4697-868b-39681372ff2f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] VM Resumed (Lifecycle Event)
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Instance spawned successfully.
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289517.7561119, 621f2153-b6a5-4697-868b-39681372ff2f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] VM Started (Lifecycle Event)
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-d3c71c72-d8af-4538-9979-d2c8af43c8b5 req-d896d352-193c-49ce-82b8-50607deebaef service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d3c71c72-d8af-4538-9979-d2c8af43c8b5 req-d896d352-193c-49ce-82b8-50607deebaef service nova] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d3c71c72-d8af-4538-9979-d2c8af43c8b5 req-d896d352-193c-49ce-82b8-50607deebaef service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d3c71c72-d8af-4538-9979-d2c8af43c8b5 req-d896d352-193c-49ce-82b8-50607deebaef service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-d3c71c72-d8af-4538-9979-d2c8af43c8b5 req-d896d352-193c-49ce-82b8-50607deebaef service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] No waiting events found dispatching network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:17 user nova-compute[72724]: WARNING nova.compute.manager [req-d3c71c72-d8af-4538-9979-d2c8af43c8b5 req-d896d352-193c-49ce-82b8-50607deebaef service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received unexpected event network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 for instance with vm_state building and task_state spawning.
Aug 17 16:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Took 6.91 seconds to build instance.
Aug 17 16:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ab3a6b1c-3d49-4435-ae67-ca1bc38f3a13 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "621f2153-b6a5-4697-868b-39681372ff2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.088s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.011s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:19 user nova-compute[72724]: INFO nova.compute.manager [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Terminating instance
Aug 17 16:25:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-4d442ab2-ca95-40a3-b86e-121f362399fc req-64d426fb-9107-4265-8e20-621332bbc1ae service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-unplugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4d442ab2-ca95-40a3-b86e-121f362399fc req-64d426fb-9107-4265-8e20-621332bbc1ae service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4d442ab2-ca95-40a3-b86e-121f362399fc req-64d426fb-9107-4265-8e20-621332bbc1ae service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4d442ab2-ca95-40a3-b86e-121f362399fc req-64d426fb-9107-4265-8e20-621332bbc1ae service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-4d442ab2-ca95-40a3-b86e-121f362399fc req-64d426fb-9107-4265-8e20-621332bbc1ae service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-unplugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-4d442ab2-ca95-40a3-b86e-121f362399fc req-64d426fb-9107-4265-8e20-621332bbc1ae service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-unplugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Instance destroyed successfully.
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lazy-loading 'resources' on Instance uuid f3f221f6-da33-46ff-be72-aadc05e46d8a {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1665195797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1665195797',id=7,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOEp8srehy0Y5WW1g9Wap03jOO4aeI30V6lciQhbwbXQFIVCDIwlY3pINy+kZ/xsaupYBEvCe9D0RWUcvYTBWt2fiabgPeP4FCfL63/zs+dze+9CudrwPKMsyTXA43METw==',key_name='tempest-keypair-301363012',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1423d90110e74cd5aef429873bd098ee',ramdisk_id='',reservation_id='r-gmsns77l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-530973025',owner_user_name='tempest-TaggedAttachmentsTest-530973025-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9e1309addf494df99a5a660510c89a01',uuid=f3f221f6-da33-46ff-be72-aadc05e46d8a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converting VIF {"id": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "address": "fa:16:3e:31:be:0a", "network": {"id": "d642d45a-4be8-4d93-b994-b8dccccd6d00", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1044141718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1423d90110e74cd5aef429873bd098ee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a7d507b-63", "ovs_interfaceid": "5a7d507b-63c6-47b2-9e30-c37f05e03f1e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG os_vif [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a7d507b-63, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:20 user nova-compute[72724]: INFO os_vif [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:be:0a,bridge_name='br-int',has_traffic_filtering=True,id=5a7d507b-63c6-47b2-9e30-c37f05e03f1e,network=Network(d642d45a-4be8-4d93-b994-b8dccccd6d00),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a7d507b-63')
Aug 17 16:25:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Deleting instance files /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a_del
Aug 17 16:25:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Deletion of /opt/stack/data/nova/instances/f3f221f6-da33-46ff-be72-aadc05e46d8a_del complete
Aug 17 16:25:20 user nova-compute[72724]: INFO nova.compute.manager [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 17 16:25:20 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:25:20 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:25:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:21 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'flavor' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:22 user nova-compute[72724]: INFO nova.compute.manager [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Attaching volume bf3bafc2-04f4-4e92-9463-5bde493a6f51 to /dev/vdb
Aug 17 16:25:22 user nova-compute[72724]: DEBUG os_brick.utils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5513d7cd-4952-4eba-9b9b-05bd886727c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7808dd5-e1ec-4303-b607-40f39f7df85d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b52eab-4dc7-477d-bdcb-3dbfc58f3a4a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[764919e9-f7a7-424f-86c6-dff58ecf8713]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:25:22 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0924ecaa-bd6e-472d-9332-7ddff8c3297b]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG os_brick.utils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating existing volume attachment record: 33502adf-d58c-4bbe-b38b-04d6735eb165 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:22 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Took 1.82 seconds to deallocate network for instance.
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] Acquiring lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] No waiting events found dispatching network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:22 user nova-compute[72724]: WARNING nova.compute.manager [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received unexpected event network-vif-plugged-5a7d507b-63c6-47b2-9e30-c37f05e03f1e for instance with vm_state deleted and task_state None.
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-5e24d5fb-9d32-42ad-a7e8-acebd2bc3fdd req-f696d17d-9a85-4c52-b49f-750fe86b5c2e service nova] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Received event network-vif-deleted-5a7d507b-63c6-47b2-9e30-c37f05e03f1e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:22 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Deleted allocations for instance f3f221f6-da33-46ff-be72-aadc05e46d8a
Aug 17 16:25:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e7bb13d2-a22f-4cf3-bb98-8c283c12b5b4 tempest-TaggedAttachmentsTest-530973025 tempest-TaggedAttachmentsTest-530973025-project-member] Lock "f3f221f6-da33-46ff-be72-aadc05e46d8a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.241s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:26 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289511.9603255, a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:25:26 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] VM Stopped (Lifecycle Event)
Aug 17 16:25:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9d389274-ead0-432a-9945-05004bce9ddc None None] [instance: a7aa11c1-9cc6-461f-b2b3-0ddabf3a84fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:25:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updating instance_info_cache with network_info: [{"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-75fd7469-8155-43cf-a93c-fac4132c8f03" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:25:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:33 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:33 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7920MB free_disk=25.891197204589844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 75fd7469-8155-43cf-a93c-fac4132c8f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance de3f1276-aa06-4843-a69a-165a7c624f8f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 621f2153-b6a5-4697-868b-39681372ff2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:25:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogFDytmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:34 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a348651-7381-426e-9cd4-6e73c65a657a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:25:34 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd963c3d-8d81-41f6-a03b-470c9ebca8d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51] added
Aug 17 16:25:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b81dab-a47c-41c0-b9d7-78052acdb806]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[df407589-6385-4096-97fb-34c3279c2ddb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogFDytmL {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogFDytmL" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[472e14f1-3983-4d80-be69-e529db4ef559]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogFDytmL'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[144596d0-2e82-42f3-9a9d-3299408371ce]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd88e02-9053-45b6-93e6-8f59a9b402aa]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7105e326-59ea-4717-9e3f-ea7e82f890dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260]
Aug 17 16:25:34 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260] successful.
Aug 17 16:25:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe88c488-9ea0-4337-bd7f-e7aff175c6a2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[873e9e70-5a50-4029-a820-8cd9b261c9dc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:34 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c6cc8-4ed5-492c-af00-e6a6eaa52b18]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:25:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogFDytmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289520.566943, f3f221f6-da33-46ff-be72-aadc05e46d8a => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:25:35 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] VM Stopped (Lifecycle Event)
Aug 17 16:25:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-85322dd9-bc9b-46de-90a2-fbf897973f96 None None] [instance: f3f221f6-da33-46ff-be72-aadc05e46d8a] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:35 user nova-compute[72724]: INFO nova.compute.manager [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Unshelving
Aug 17 16:25:35 user nova-compute[72724]: INFO nova.virt.block_device [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Booting with volume 39ac30ff-b1c2-4dfb-8d57-070e8558fb2a at /dev/vdc
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23435373563613530', 'path': '/dev/sdh'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435373563613530', 'path': '/dev/sdh'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'flavor' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.utils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:25:35 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:25:35 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:25:35 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:25:35 user nova-compute[72724]:   <serial>bf3bafc2-04f4-4e92-9463-5bde493a6f51</serial>
Aug 17 16:25:35 user nova-compute[72724]: </disk>
Aug 17 16:25:35 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb127314-70c5-41d8-98d5-06c24fb85aa7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca95c33-f3e4-48dd-9d23-b98564ec7f41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[339413a1-4e45-414e-a442-b3c903b2d743]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c182dc99-dfe1-4cb8-b4b2-e8e00b99fcf7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:25:35 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:25:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db67e66-23eb-406a-be6b-89b5664e2495]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG os_brick.utils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:35 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating existing volume attachment record: 5c1383e6-049d-4eed-a1e5-0d1bc5666586 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:25:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No VIF found with MAC fa:16:3e:9b:aa:68, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:25:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5918d765-2776-4040-bb81-9dfee61024ea tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:37 user nova-compute[72724]: INFO nova.compute.manager [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Rescuing
Aug 17 16:25:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:25:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance destroyed successfully.
Aug 17 16:25:38 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Attempting a stable device rescue
Aug 17 16:25:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72724) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:25:38 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Creating image(s)
Aug 17 16:25:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'trusted_certs' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "57254646b746b3b15377c8491a02e0e384061110" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "57254646b746b3b15377c8491a02e0e384061110" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-e43cac0e-9c02-4f8d-ac39-a9170ba0332b req-c83d742d-db3a-417d-adc0-de3b3892af24 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e43cac0e-9c02-4f8d-ac39-a9170ba0332b req-c83d742d-db3a-417d-adc0-de3b3892af24 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e43cac0e-9c02-4f8d-ac39-a9170ba0332b req-c83d742d-db3a-417d-adc0-de3b3892af24 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e43cac0e-9c02-4f8d-ac39-a9170ba0332b req-c83d742d-db3a-417d-adc0-de3b3892af24 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-e43cac0e-9c02-4f8d-ac39-a9170ba0332b req-c83d742d-db3a-417d-adc0-de3b3892af24 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:40 user nova-compute[72724]: WARNING nova.compute.manager [req-e43cac0e-9c02-4f8d-ac39-a9170ba0332b req-c83d742d-db3a-417d-adc0-de3b3892af24 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.part --force-share --output=json" returned: 0 in 0.217s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG nova.virt.images [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] 0f6c44b5-864b-4c79-815d-c862f5cceaa4 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.part /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.part /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.converted" returned: 0 in 0.660s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110.converted --force-share --output=json" returned: 0 in 0.237s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "57254646b746b3b15377c8491a02e0e384061110" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.224s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "57254646b746b3b15377c8491a02e0e384061110" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "57254646b746b3b15377c8491a02e0e384061110" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110 --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110,backing_fmt=raw /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110,backing_fmt=raw /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue" returned: 0 in 0.052s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "57254646b746b3b15377c8491a02e0e384061110" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'migration_context' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Start _get_guest_xml network_info=[{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "vif_mac": "fa:16:3e:9b:aa:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0f6c44b5-864b-4c79-815d-c862f5cceaa4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '33502adf-d58c-4bbe-b38b-04d6735eb165', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogFDytmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'bab1abaa-414c-4c50-ae78-be9126d9aafc', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf3bafc2-04f4-4e92-9463-5bde493a6f51', 'serial': 'bf3bafc2-04f4-4e92-9463-5bde493a6f51'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'resources' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'numa_topology' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:41 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:41 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'vcpu_model' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogFDytmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:41 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:41 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:41 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccfb20d-73e8-4c64-b15c-ea14aa420dae]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ogFDytmL\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 16:25:41 user nova-compute[72724]: node.name = iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51
Aug 17 16:25:41 user nova-compute[72724]: node.tpgt = -1
Aug 17 16:25:41 user nova-compute[72724]: node.startup = automatic
Aug 17 16:25:41 user nova-compute[72724]: node.leading_login = No
Aug 17 16:25:41 user nova-compute[72724]: iface.iscsi_ifacename = default
Aug 17 16:25:41 user nova-compute[72724]: iface.net_ifacename = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.ipaddress = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.prefix_len = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.hwaddress = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.transport_name = tcp
Aug 17 16:25:41 user nova-compute[72724]: iface.initiatorname = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.vlan_id = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.vlan_priority = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.vlan_state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.iface_num = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.mtu = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.port = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.bootproto = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.subnet_mask = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.gateway = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_alt_client_id = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_dns = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_learn_iqn = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_vendor_id_state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_vendor_id = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.dhcp_slp_da = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.fragmentation = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.gratuitous_arp = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.incoming_forwarding = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.tos_state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.tos = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.ttl = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.delayed_ack = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.tcp_nagle = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.tcp_wsf_state = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.tcp_wsf = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.tcp_timer_scale = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.tcp_timestamp = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.redirect = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.def_task_mgmt_timeout = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.header_digest = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.data_digest = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.immediate_data = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.initial_r2t = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.data_seq_inorder = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.data_pdu_inorder = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.erl = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.max_receive_data_len = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.first_burst_len = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.max_outstanding_r2t = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.max_burst_len = 0
Aug 17 16:25:41 user nova-compute[72724]: iface.chap_auth = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.bidi_chap = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.strict_login_compliance = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.discovery_auth = <empty>
Aug 17 16:25:41 user nova-compute[72724]: iface.discovery_logout = <empty>
Aug 17 16:25:41 user nova-compute[72724]: node.discovery_address = <empty>
Aug 17 16:25:41 user nova-compute[72724]: node.discovery_port = 0
Aug 17 16:25:41 user nova-compute[72724]: node.discovery_type = static
Aug 17 16:25:41 user nova-compute[72724]: node.session.initial_cmdsn = 0
Aug 17 16:25:41 user nova-compute[72724]: node.session.initial_login_retry_max = 8
Aug 17 16:25:41 user nova-compute[72724]: node.session.xmit_thread_priority = -20
Aug 17 16:25:41 user nova-compute[72724]: node.session.cmds_max = 128
Aug 17 16:25:41 user nova-compute[72724]: node.session.queue_depth = 32
Aug 17 16:25:41 user nova-compute[72724]: node.session.nr_sessions = 1
Aug 17 16:25:41 user nova-compute[72724]: node.session.auth.authmethod = CHAP
Aug 17 16:25:41 user nova-compute[72724]: node.session.auth.username = ogFDytmL
Aug 17 16:25:41 user nova-compute[72724]: node.session.auth.password = ***
Aug 17 16:25:41 user nova-compute[72724]: node.session.auth.username_in = <empty>
Aug 17 16:25:41 user nova-compute[72724]: node.session.auth.password_in = <empty>
Aug 17 16:25:41 user nova-compute[72724]: node.session.auth.chap_algs = MD5
Aug 17 16:25:41 user nova-compute[72724]: node.session.timeo.replacement_timeout = 120
Aug 17 16:25:41 user nova-compute[72724]: node.session.err_timeo.abort_timeout = 15
Aug 17 16:25:41 user nova-compute[72724]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 16:25:41 user nova-compute[72724]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 16:25:41 user nova-compute[72724]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.FastAbort = Yes
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.InitialR2T = No
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.ImmediateData = Yes
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.MaxConnections = 1
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 16:25:41 user nova-compute[72724]: node.session.iscsi.ERL = 0
Aug 17 16:25:41 user nova-compute[72724]: node.session.scan = manual
Aug 17 16:25:41 user nova-compute[72724]: node.session.reopen_max = 0
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].address = 172.16.0.220
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].port = 3260
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].startup = manual
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].tcp.window_size = 524288
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].tcp.type_of_service = 0
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].timeo.logout_timeout = 15
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].timeo.login_timeout = 15
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].timeo.auth_timeout = 45
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].iscsi.DataDigest = None
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].iscsi.IFMarker = No
Aug 17 16:25:41 user nova-compute[72724]: node.conn[0].iscsi.OFMarker = No
Aug 17 16:25:41 user nova-compute[72724]: # END RECORD
Aug 17 16:25:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e997cdb-c068-41b3-8da0-f8e92845b715]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[70843864-65ba-44ab-9d70-6673091ea8c1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogFDytmL {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogFDytmL" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e635b5-9cfa-4e45-b655-45b3ddaab6b5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogFDytmL'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d324acf-26c8-4133-ad96-9a1d355022d8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b6ce3b-4386-43f3-be8c-d53f2ba8966c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:41 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.177s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] HCTL ('39', '0', '0', 0) found on session 14 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997db16-4f6a-47b9-a25a-cb5eddcf8285]: (4, ('0 0 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Searching for a device in session 14 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogFDytmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23435373563613530', 'path': '/dev/sdh'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435373563613530', 'path': '/dev/sdh'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-582266070',display_name='tempest-ServerStableDeviceRescueTest-server-582266070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-582266070',id=2,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIj+ap/KOFchCg9v9kt6fYGpAv+Mvxn0PJW/oauRh73tKZWQAsQ4FM9ZriNj8mncH9E1li97b38WzbNB5Dm6dP7hywQlbsLzeTK9viM3b8J9CU24Q41zNAmpx3cVQXjJQ==',key_name='tempest-keypair-1867058309',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:21:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e8428c63a474e2bb1d26c44c7a0e2c1',ramdisk_id='',reservation_id='r-m0z751gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-890446162',owner_user_name='tempest-ServerStableDeviceRescueTest-890446162-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:23:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d21c9e7f6c3546fbaabef5fef9ba367e',uuid=bab1abaa-414c-4c50-ae78-be9126d9aafc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "vif_mac": "fa:16:3e:9b:aa:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converting VIF {"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "vif_mac": "fa:16:3e:9b:aa:68"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'pci_devices' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:25:41 user nova-compute[72724]:   <uuid>bab1abaa-414c-4c50-ae78-be9126d9aafc</uuid>
Aug 17 16:25:41 user nova-compute[72724]:   <name>instance-00000002</name>
Aug 17 16:25:41 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:25:41 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:25:41 user nova-compute[72724]:   <metadata>
Aug 17 16:25:41 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:25:41 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:25:41 user nova-compute[72724]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-582266070</nova:name>
Aug 17 16:25:41 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:25:41</nova:creationTime>
Aug 17 16:25:41 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:25:41 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:25:41 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:25:41 user nova-compute[72724]:       <nova:owner>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:user uuid="d21c9e7f6c3546fbaabef5fef9ba367e">tempest-ServerStableDeviceRescueTest-890446162-project-member</nova:user>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:project uuid="0e8428c63a474e2bb1d26c44c7a0e2c1">tempest-ServerStableDeviceRescueTest-890446162</nova:project>
Aug 17 16:25:41 user nova-compute[72724]:       </nova:owner>
Aug 17 16:25:41 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:25:41 user nova-compute[72724]:       <nova:ports>
Aug 17 16:25:41 user nova-compute[72724]:         <nova:port uuid="7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d">
Aug 17 16:25:41 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 16:25:41 user nova-compute[72724]:         </nova:port>
Aug 17 16:25:41 user nova-compute[72724]:       </nova:ports>
Aug 17 16:25:41 user nova-compute[72724]:     </nova:instance>
Aug 17 16:25:41 user nova-compute[72724]:   </metadata>
Aug 17 16:25:41 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:25:41 user nova-compute[72724]:     <system>
Aug 17 16:25:41 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:25:41 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:25:41 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:25:41 user nova-compute[72724]:       <entry name="serial">bab1abaa-414c-4c50-ae78-be9126d9aafc</entry>
Aug 17 16:25:41 user nova-compute[72724]:       <entry name="uuid">bab1abaa-414c-4c50-ae78-be9126d9aafc</entry>
Aug 17 16:25:41 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:25:41 user nova-compute[72724]:     </system>
Aug 17 16:25:41 user nova-compute[72724]:   </sysinfo>
Aug 17 16:25:41 user nova-compute[72724]:   <os>
Aug 17 16:25:41 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:25:41 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:25:41 user nova-compute[72724]:   </os>
Aug 17 16:25:41 user nova-compute[72724]:   <features>
Aug 17 16:25:41 user nova-compute[72724]:     <acpi/>
Aug 17 16:25:41 user nova-compute[72724]:     <apic/>
Aug 17 16:25:41 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:25:41 user nova-compute[72724]:   </features>
Aug 17 16:25:41 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:25:41 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:25:41 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:25:41 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:25:41 user nova-compute[72724]:   </clock>
Aug 17 16:25:41 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:25:41 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:25:41 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:25:41 user nova-compute[72724]:   </cpu>
Aug 17 16:25:41 user nova-compute[72724]:   <devices>
Aug 17 16:25:41 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:25:41 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:25:41 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk"/>
Aug 17 16:25:41 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:25:41 user nova-compute[72724]:     </disk>
Aug 17 16:25:41 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:25:41 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:25:41 user nova-compute[72724]:       <source dev="/dev/sdh"/>
Aug 17 16:25:41 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:25:41 user nova-compute[72724]:       <serial>bf3bafc2-04f4-4e92-9463-5bde493a6f51</serial>
Aug 17 16:25:41 user nova-compute[72724]:     </disk>
Aug 17 16:25:41 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:25:41 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:25:41 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue"/>
Aug 17 16:25:41 user nova-compute[72724]:       <target dev="vdc" bus="virtio"/>
Aug 17 16:25:41 user nova-compute[72724]:       <boot order="1"/>
Aug 17 16:25:41 user nova-compute[72724]:     </disk>
Aug 17 16:25:41 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:25:41 user nova-compute[72724]:       <mac address="fa:16:3e:9b:aa:68"/>
Aug 17 16:25:41 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:41 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:25:41 user nova-compute[72724]:       <target dev="tap7d1dd947-fb"/>
Aug 17 16:25:41 user nova-compute[72724]:     </interface>
Aug 17 16:25:41 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:25:41 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/console.log" append="off"/>
Aug 17 16:25:41 user nova-compute[72724]:     </serial>
Aug 17 16:25:41 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:25:41 user nova-compute[72724]:     <video>
Aug 17 16:25:41 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:41 user nova-compute[72724]:     </video>
Aug 17 16:25:41 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:25:41 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:25:41 user nova-compute[72724]:     </rng>
Aug 17 16:25:41 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:25:41 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:25:41 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:25:41 user nova-compute[72724]:     </memballoon>
Aug 17 16:25:41 user nova-compute[72724]:   </devices>
Aug 17 16:25:41 user nova-compute[72724]: </domain>
Aug 17 16:25:41 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:25:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance destroyed successfully.
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] No VIF found with MAC fa:16:3e:9b:aa:68, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-dbbb5891-798f-4244-9dad-b36cb4e475a1 req-203a81a9-720d-4d47-b047-81273e32da5c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dbbb5891-798f-4244-9dad-b36cb4e475a1 req-203a81a9-720d-4d47-b047-81273e32da5c service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dbbb5891-798f-4244-9dad-b36cb4e475a1 req-203a81a9-720d-4d47-b047-81273e32da5c service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dbbb5891-798f-4244-9dad-b36cb4e475a1 req-203a81a9-720d-4d47-b047-81273e32da5c service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-dbbb5891-798f-4244-9dad-b36cb4e475a1 req-203a81a9-720d-4d47-b047-81273e32da5c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:41 user nova-compute[72724]: WARNING nova.compute.manager [req-dbbb5891-798f-4244-9dad-b36cb4e475a1 req-203a81a9-720d-4d47-b047-81273e32da5c service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-changed-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing instance network info cache due to event network-changed-758b2d53-09eb-4c58-a714-ed93860689d1. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] Acquiring lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] Acquired lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Refreshing network info cache for port 758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:44 user nova-compute[72724]: WARNING nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:44 user nova-compute[72724]: WARNING nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:44 user nova-compute[72724]: WARNING nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:44 user nova-compute[72724]: WARNING nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:44 user nova-compute[72724]: WARNING nova.compute.manager [req-daddf1c1-3f9b-4d12-b1ae-14c6f5da6616 req-0f76712c-0bd0-4c29-9934-fb367d170ce1 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state rescuing.
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updated VIF entry in instance network info cache for port 758b2d53-09eb-4c58-a714-ed93860689d1. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c0c5371b-4ce6-4889-9919-30bc3307ffcf req-8d4e0eed-48aa-42f3-af14-6a7f51fb1f42 service nova] Releasing lock "refresh_cache-de3f1276-aa06-4843-a69a-165a7c624f8f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for bab1abaa-414c-4c50-ae78-be9126d9aafc due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289545.4403887, bab1abaa-414c-4c50-ae78-be9126d9aafc => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:25:45 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Resumed (Lifecycle Event)
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ef753b1d-c451-4e43-b8eb-5b4ece53d97e tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:25:45 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289545.4416208, bab1abaa-414c-4c50-ae78-be9126d9aafc => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:25:45 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Started (Lifecycle Event)
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-b072dea5-dbcb-44c9-bc68-bcbd89b00ab2 req-a1c5b00e-5510-49b5-93e4-702b6caf55dc service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b072dea5-dbcb-44c9-bc68-bcbd89b00ab2 req-a1c5b00e-5510-49b5-93e4-702b6caf55dc service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b072dea5-dbcb-44c9-bc68-bcbd89b00ab2 req-a1c5b00e-5510-49b5-93e4-702b6caf55dc service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b072dea5-dbcb-44c9-bc68-bcbd89b00ab2 req-a1c5b00e-5510-49b5-93e4-702b6caf55dc service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-b072dea5-dbcb-44c9-bc68-bcbd89b00ab2 req-a1c5b00e-5510-49b5-93e4-702b6caf55dc service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:46 user nova-compute[72724]: WARNING nova.compute.manager [req-b072dea5-dbcb-44c9-bc68-bcbd89b00ab2 req-a1c5b00e-5510-49b5-93e4-702b6caf55dc service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state rescued and task_state None.
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:46 user nova-compute[72724]: INFO nova.compute.manager [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Terminating instance
Aug 17 16:25:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-6fd2dc35-d703-4c24-81f5-e30d57d6420c req-256f13a6-2979-4344-a1b0-fac76e6c1069 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6fd2dc35-d703-4c24-81f5-e30d57d6420c req-256f13a6-2979-4344-a1b0-fac76e6c1069 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6fd2dc35-d703-4c24-81f5-e30d57d6420c req-256f13a6-2979-4344-a1b0-fac76e6c1069 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6fd2dc35-d703-4c24-81f5-e30d57d6420c req-256f13a6-2979-4344-a1b0-fac76e6c1069 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-6fd2dc35-d703-4c24-81f5-e30d57d6420c req-256f13a6-2979-4344-a1b0-fac76e6c1069 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-6fd2dc35-d703-4c24-81f5-e30d57d6420c req-256f13a6-2979-4344-a1b0-fac76e6c1069 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-758b2d53-09eb-4c58-a714-ed93860689d1 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-178aa5b1-ebb6-4779-b202-b1fb0f8675ef req-bef20f6a-8023-4404-933a-6014fe83ca5b service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-178aa5b1-ebb6-4779-b202-b1fb0f8675ef req-bef20f6a-8023-4404-933a-6014fe83ca5b service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-178aa5b1-ebb6-4779-b202-b1fb0f8675ef req-bef20f6a-8023-4404-933a-6014fe83ca5b service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-178aa5b1-ebb6-4779-b202-b1fb0f8675ef req-bef20f6a-8023-4404-933a-6014fe83ca5b service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-178aa5b1-ebb6-4779-b202-b1fb0f8675ef req-bef20f6a-8023-4404-933a-6014fe83ca5b service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-178aa5b1-ebb6-4779-b202-b1fb0f8675ef req-bef20f6a-8023-4404-933a-6014fe83ca5b service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-18020b51-b71d-4705-b14d-e53a385e5599 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Instance destroyed successfully.
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lazy-loading 'resources' on Instance uuid de3f1276-aa06-4843-a69a-165a7c624f8f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap758b2d53-09, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-a777c43d-59bc-4d73-b99c-69791dc7938b for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: WARNING nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-a777c43d-59bc-4d73-b99c-69791dc7938b for instance with vm_state active and task_state deleting.
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-90c074dd-d736-458b-932a-f0383adcce60 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: WARNING nova.compute.manager [req-4bd65688-dd48-49ff-ac6e-3f332ca1a631 req-256e7ee3-b4de-4c67-8617-06e6f22f99e8 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-90c074dd-d736-458b-932a-f0383adcce60 for instance with vm_state active and task_state deleting.
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:84:1a,bridge_name='br-int',has_traffic_filtering=True,id=758b2d53-09eb-4c58-a714-ed93860689d1,network=Network(7f0dd1a9-377b-4b85-91f6-ba66af45bd74),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap758b2d53-09')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa777c43d-59, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:4c:02,bridge_name='br-int',has_traffic_filtering=True,id=a777c43d-59bc-4d73-b99c-69791dc7938b,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa777c43d-59')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap18020b51-b7, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:86:7c,bridge_name='br-int',has_traffic_filtering=True,id=18020b51-b71d-4705-b14d-e53a385e5599,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap18020b51-b7')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "address": "fa:16:3e:37:23:40", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.135", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3fac642-9c", "ovs_interfaceid": "b3fac642-9cee-4d26-b66f-3d939b1e8ce9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3fac642-9c, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:23:40,bridge_name='br-int',has_traffic_filtering=True,id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3fac642-9c')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ddfde5f-c5, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:31:fd,bridge_name='br-int',has_traffic_filtering=True,id=8ddfde5f-c528-4dd4-962e-befe7adff8cd,network=Network(6f564bee-7d88-4250-9fcb-eb73bc1617b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ddfde5f-c5')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap90c074dd-d7, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:5b:d1,bridge_name='br-int',has_traffic_filtering=True,id=90c074dd-d736-458b-932a-f0383adcce60,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap90c074dd-d7')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:22:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1309932517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1309932517',id=8,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPJRRwBPG+egHAAdjSXHVWyd2l2tNuB6cmzI9tybgnEgQmtl132wLQlj4zdk1SO+BKlBJsC6hIdK/pPatEG2FQbkONVV9WlXfxX5TZ8ufQSBjw8K6BgWmy0n1EWWXvdCg==',key_name='tempest-keypair-1951005009',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa128727c09e41048060f71bbd08239b',ramdisk_id='',reservation_id='r-4fzco2ed',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1054668907',owner_user_name='tempest-TaggedBootDevicesTest-1054668907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:23:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fd8a7c85787642d29b8d04b579fa92ad',uuid=de3f1276-aa06-4843-a69a-165a7c624f8f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converting VIF {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0cef184-4e, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:48 user nova-compute[72724]: INFO os_vif [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:31:fb,bridge_name='br-int',has_traffic_filtering=True,id=a0cef184-4efb-44e9-b54e-def6b34d364d,network=Network(909fe18c-bd23-4de6-9182-284922e8d3cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0cef184-4e')
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBshEPXL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:48 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13068dc4-785a-4d6a-900c-ae041bd57ea9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf37d1d-3c84-4555-a21b-4757033a7d34]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0277880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: WARNING nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-758b2d53-09eb-4c58-a714-ed93860689d1 for instance with vm_state active and task_state deleting.
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:48 user nova-compute[72724]: WARNING nova.compute.manager [req-2bb95998-2f05-46a1-ae0e-2581a5e40174 req-f4fa89db-eab8-470d-abc6-979cfa32e8eb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 for instance with vm_state active and task_state deleting.
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b152c5-1a56-47e8-a89f-0307cad9db68]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05820607-f2ec-4c62-8777-7abffe690215]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a9feb5-1a0e-416a-8709-fb146f675116]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[541b5715-c989-4aac-bb20-ad96af1ccc37]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbd1786-34fc-4321-94e5-4c938bec10f1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2837fa3-ecfe-417e-980c-6ed9885e1886]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260]
Aug 17 16:25:48 user nova-compute[72724]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491, portal: 172.16.0.220,3260] successful.
Aug 17 16:25:48 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b44bdbc-6571-4ff5-afa5-c50cd17f2491 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8babb7c4-554b-4db6-95a3-09436fec957f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== disconnect_volume: return (346ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RNLsGlQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:48 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[58140526-26a6-40b3-aa05-7903df6069b9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[87508fec-ec9c-4915-9836-cd0ef22dedb7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:48 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:48 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119'): ({'sdd'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Removing single pathed devices sdd {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2ac83c-d2a7-42a2-b82e-642082522689]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.087s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4789b09b-74be-4caa-8e20-24e560ae4897]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Flushing IO for device /dev/sdd {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdf48fb-1f62-40f0-a101-67f40de6b254]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bef19d-d9ba-4b75-8d32-0f4e13a2c997]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.111s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05cbbbb-dfaf-42ea-8287-fb5f73e6ef86]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:49 user nova-compute[72724]: WARNING nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-18020b51-b71d-4705-b14d-e53a385e5599 for instance with vm_state active and task_state deleting.
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:49 user nova-compute[72724]: WARNING nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-8ddfde5f-c528-4dd4-962e-befe7adff8cd for instance with vm_state active and task_state deleting.
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-unplugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-unplugged-a0cef184-4efb-44e9-b54e-def6b34d364d for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Acquiring lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] No waiting events found dispatching network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:49 user nova-compute[72724]: WARNING nova.compute.manager [req-35698c3a-a8e6-431a-8dc5-b43ed1d60607 req-5eece122-a695-4648-ba55-b47978360e9a service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received unexpected event network-vif-plugged-a0cef184-4efb-44e9-b54e-def6b34d364d for instance with vm_state active and task_state deleting.
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f999ba-a4f9-4324-a61f-9dfb2afa95e3]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260]
Aug 17 16:25:49 user nova-compute[72724]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119, portal: 172.16.0.220,3260] successful.
Aug 17 16:25:49 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'pci_requests' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'numa_topology' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:82f51d00-f47f-4c69-b95d-3cf2d5d55119 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a346997-c92e-4738-99fc-7c70680b6081]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:25:49 user nova-compute[72724]: INFO nova.compute.claims [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Claim successful on node user
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.505s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== disconnect_volume: return (507ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ItASTVqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:49 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035f6eb-2fee-42e3-ae18-9759828fb93a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[833d1262-945e-4d76-87bc-78a2727c2526]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:49 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:49 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e811a170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dc4ab8-8954-46cb-a9c7-c8bd5d375888]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f21a180-4441-4d1a-bb5d-d9410dc62bab]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5162218-dde7-48df-8887-8b0c5fdbd3da]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[994173d4-95c9-41c4-8b29-3ab021502e90]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a68b19-518a-4b20-b71c-cd51a3b18581]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2af9e75-b30a-418a-9d58-9d15e169c4c9]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260]
Aug 17 16:25:49 user nova-compute[72724]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26, portal: 172.16.0.220,3260] successful.
Aug 17 16:25:49 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:899b34a2-503c-4785-b42c-edf92beefc26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2221826f-2d9e-4fac-a402-0cb94630be69]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] <== disconnect_volume: return (339ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:25:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Deleting instance files /opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f_del
Aug 17 16:25:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Deletion of /opt/stack/data/nova/instances/de3f1276-aa06-4843-a69a-165a7c624f8f_del complete
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:49 user nova-compute[72724]: INFO nova.compute.manager [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Took 3.54 seconds to destroy the instance on the hypervisor.
Aug 17 16:25:49 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:25:49 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:25:49 user nova-compute[72724]: INFO nova.network.neutron [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating port af4682ae-3a41-498e-a6b5-90e3492b5e80 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing instance network info cache due to event network-changed-af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:25:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] Acquiring lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:25:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Creating image(s)
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'trusted_certs' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] Acquired lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG nova.network.neutron [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Refreshing network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "05fab0e04e893be685fde5a9a537b001931db964" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "05fab0e04e893be685fde5a9a537b001931db964" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.part --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:52 user nova-compute[72724]: DEBUG nova.virt.images [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] c1280c96-2a67-4163-84fb-5904e2cb96c8 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:25:52 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:25:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.part /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.part /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.converted" returned: 0 in 0.544s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7cc4cf5d-3279-4fc4-aad7-003c87fe5e9e req-3b3053c6-036b-4408-aef4-9b0e18886379 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-deleted-b3fac642-9cee-4d26-b66f-3d939b1e8ce9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:53 user nova-compute[72724]: INFO nova.compute.manager [req-7cc4cf5d-3279-4fc4-aad7-003c87fe5e9e req-3b3053c6-036b-4408-aef4-9b0e18886379 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Neutron deleted interface b3fac642-9cee-4d26-b66f-3d939b1e8ce9; detaching it from the instance and deleting it from the info cache
Aug 17 16:25:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-7cc4cf5d-3279-4fc4-aad7-003c87fe5e9e req-3b3053c6-036b-4408-aef4-9b0e18886379 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "758b2d53-09eb-4c58-a714-ed93860689d1", "address": "fa:16:3e:ac:84:1a", "network": {"id": "7f0dd1a9-377b-4b85-91f6-ba66af45bd74", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-164155954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.214", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap758b2d53-09", "ovs_interfaceid": "758b2d53-09eb-4c58-a714-ed93860689d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7cc4cf5d-3279-4fc4-aad7-003c87fe5e9e req-3b3053c6-036b-4408-aef4-9b0e18886379 service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Detach interface failed, port_id=b3fac642-9cee-4d26-b66f-3d939b1e8ce9, reason: Instance de3f1276-aa06-4843-a69a-165a7c624f8f could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "05fab0e04e893be685fde5a9a537b001931db964" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.486s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updated VIF entry in instance network info cache for port af4682ae-3a41-498e-a6b5-90e3492b5e80. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ce275edb-ebd3-4ead-a30b-04d860559318 req-cb8a3104-6e82-4650-a92b-f662567dc359 service nova] Releasing lock "refresh_cache-254406ea-145e-40ff-8252-9e4a28db4892" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "05fab0e04e893be685fde5a9a537b001931db964" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "05fab0e04e893be685fde5a9a537b001931db964" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964,backing_fmt=raw /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964,backing_fmt=raw /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk 1073741824" returned: 0 in 0.054s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "05fab0e04e893be685fde5a9a537b001931db964" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'migration_context' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Rebasing disk image.
Aug 17 16:25:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b -F raw /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-changed-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing instance network info cache due to event network-changed-30053a0b-9af1-4a83-b2fb-aeef68758317. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] Acquiring lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] Acquired lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Refreshing network info cache for port 30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:25:55 user nova-compute[72724]: INFO nova.compute.claims [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Claim successful on node user
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updated VIF entry in instance network info cache for port 30053a0b-9af1-4a83-b2fb-aeef68758317. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c3808871-e98f-4392-b663-caad042a6b34 req-05f1d34f-30be-402c-9891-de65a1da2537 service nova] Releasing lock "refresh_cache-32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-deleted-758b2d53-09eb-4c58-a714-ed93860689d1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:55 user nova-compute[72724]: INFO nova.compute.manager [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Neutron deleted interface 758b2d53-09eb-4c58-a714-ed93860689d1; detaching it from the instance and deleting it from the info cache
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0cef184-4efb-44e9-b54e-def6b34d364d", "address": "fa:16:3e:05:31:fb", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0cef184-4e", "ovs_interfaceid": "a0cef184-4efb-44e9-b54e-def6b34d364d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Detach interface failed, port_id=758b2d53-09eb-4c58-a714-ed93860689d1, reason: Instance de3f1276-aa06-4843-a69a-165a7c624f8f could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-deleted-a0cef184-4efb-44e9-b54e-def6b34d364d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:55 user nova-compute[72724]: INFO nova.compute.manager [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Neutron deleted interface a0cef184-4efb-44e9-b54e-def6b34d364d; detaching it from the instance and deleting it from the info cache
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [{"id": "a777c43d-59bc-4d73-b99c-69791dc7938b", "address": "fa:16:3e:8c:4c:02", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa777c43d-59", "ovs_interfaceid": "a777c43d-59bc-4d73-b99c-69791dc7938b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "18020b51-b71d-4705-b14d-e53a385e5599", "address": "fa:16:3e:96:86:7c", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.219", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap18020b51-b7", "ovs_interfaceid": "18020b51-b71d-4705-b14d-e53a385e5599", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "address": "fa:16:3e:b0:31:fd", "network": {"id": "6f564bee-7d88-4250-9fcb-eb73bc1617b9", "bridge": "br-int", "label": "tempest-device-tagging-net1-691117734", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.225", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ddfde5f-c5", "ovs_interfaceid": "8ddfde5f-c528-4dd4-962e-befe7adff8cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "90c074dd-d736-458b-932a-f0383adcce60", "address": "fa:16:3e:a6:5b:d1", "network": {"id": "909fe18c-bd23-4de6-9182-284922e8d3cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-43787586", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "aa128727c09e41048060f71bbd08239b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap90c074dd-d7", "ovs_interfaceid": "90c074dd-d736-458b-932a-f0383adcce60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f81fcd01-98e4-4973-bf4b-ee5b1701cfe7 req-af87266e-d514-4d20-ae73-4907dabfd0ff service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Detach interface failed, port_id=a0cef184-4efb-44e9-b54e-def6b34d364d, reason: Instance de3f1276-aa06-4843-a69a-165a7c624f8f could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:25:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:25:55 user nova-compute[72724]: DEBUG nova.policy [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d2156bdcb9f4e259b40ee4827796598', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '140ed8b03f1c405f893dea0fce1855a6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:56 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Took 6.42 seconds to deallocate network for instance.
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:25:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Creating image(s)
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "/opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "/opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk 1073741824" returned: 0 in 0.053s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Successfully created port: 9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b -F raw /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk" returned: 0 in 2.569s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Ensure instance console log exists: /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Start _get_guest_xml network_info=[{"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c6e52a859c63c519009277b3679bddf1',container_format='bare',created_at=2023-08-17T16:23:43Z,direct_url=<?>,disk_format='qcow2',id=c1280c96-2a67-4163-84fb-5904e2cb96c8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-598960467-shelved',owner='43b9b4c4d963430e95e8b6fb484c9889',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T16:23:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5c1383e6-049d-4eed-a1e5-0d1bc5666586', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihwseHcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '254406ea-145e-40ff-8252-9e4a28db4892', 'attached_at': '', 'detached_at': '', 'volume_id': '39ac30ff-b1c2-4dfb-8d57-070e8558fb2a', 'serial': '39ac30ff-b1c2-4dfb-8d57-070e8558fb2a'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:25:56 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:56 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c6e52a859c63c519009277b3679bddf1',container_format='bare',created_at=2023-08-17T16:23:43Z,direct_url=<?>,disk_format='qcow2',id=c1280c96-2a67-4163-84fb-5904e2cb96c8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-598960467-shelved',owner='43b9b4c4d963430e95e8b6fb484c9889',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T16:23:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:25:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'vcpu_model' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihwseHcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:25:57 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:57 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:25:57 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d22fe55-8c1f-4546-98d8-10f131b7b2df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:25:57 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Cannot resize image /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lazy-loading 'migration_context' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Ensure instance console log exists: /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2612f891-7191-4147-82b9-b080c0cabaee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a] added
Aug 17 16:25:57 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a2bc2-0256-453a-a933-ea10baf7e204]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d088ab-37f9-4411-bd7f-bdd64fc8efa3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihwseHcU {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ihwseHcU" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7076b87d-d6e0-4d1f-8432-8cb9d026676a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ihwseHcU'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3799f9-f914-4eb7-9350-cafb15314a91]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a199e30f-5e03-46ee-853d-0a2947c96b5a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c401b0d9-24b3-4c59-9837-a5058b41bb84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260]
Aug 17 16:25:57 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260] successful.
Aug 17 16:25:57 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6831ca9c-5d4a-4eca-a8e5-ac624d76292b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[94fbcfd8-f0cb-41aa-b9f9-65251cd8192c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:25:57 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:25:57 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[311d66f8-995d-43fc-9755-1b6bdd5c60a3]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-33627734-3d7a-46d8-a1d4-8b8dde856bc0 req-083fdea1-3f07-48b6-a93d-b0893adc30cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-deleted-8ddfde5f-c528-4dd4-962e-befe7adff8cd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-33627734-3d7a-46d8-a1d4-8b8dde856bc0 req-083fdea1-3f07-48b6-a93d-b0893adc30cb service nova] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Received event network-vif-deleted-90c074dd-d736-458b-932a-f0383adcce60 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:57 user nova-compute[72724]: INFO nova.compute.manager [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Terminating instance
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Successfully updated port: 9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquired lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-changed-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Refreshing instance network info cache due to event network-changed-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] Acquiring lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff587d42-8a49-417a-a021-7bf726c8d148 req-441dfb89-5efe-4716-875c-f47d557db382 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff587d42-8a49-417a-a021-7bf726c8d148 req-441dfb89-5efe-4716-875c-f47d557db382 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff587d42-8a49-417a-a021-7bf726c8d148 req-441dfb89-5efe-4716-875c-f47d557db382 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff587d42-8a49-417a-a021-7bf726c8d148 req-441dfb89-5efe-4716-875c-f47d557db382 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff587d42-8a49-417a-a021-7bf726c8d148 req-441dfb89-5efe-4716-875c-f47d557db382 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff587d42-8a49-417a-a021-7bf726c8d148 req-441dfb89-5efe-4716-875c-f47d557db382 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihwseHcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.361s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '23738633337356166', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738633337356166', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-598960467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-598960467',id=3,image_ref='c1280c96-2a67-4163-84fb-5904e2cb96c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-513051232',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-o12a1ie6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member',shelved_at='2023-08-17T16:23:47.659480',shelved_host='user',shelved_image_id='c1280c96-2a67-4163-84fb-5904e2cb96c8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:25:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=254406ea-145e-40ff-8252-9e4a28db4892,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'pci_devices' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:25:58 user nova-compute[72724]:   <uuid>254406ea-145e-40ff-8252-9e4a28db4892</uuid>
Aug 17 16:25:58 user nova-compute[72724]:   <name>instance-00000003</name>
Aug 17 16:25:58 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:25:58 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:25:58 user nova-compute[72724]:   <metadata>
Aug 17 16:25:58 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:25:58 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-598960467</nova:name>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:25:56</nova:creationTime>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:25:58 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:25:58 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:owner>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:user uuid="8041c5cb8ad64f64b31aab70052e4f02">tempest-AttachVolumeShelveTestJSON-239110034-project-member</nova:user>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:project uuid="43b9b4c4d963430e95e8b6fb484c9889">tempest-AttachVolumeShelveTestJSON-239110034</nova:project>
Aug 17 16:25:58 user nova-compute[72724]:       </nova:owner>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:root type="image" uuid="c1280c96-2a67-4163-84fb-5904e2cb96c8"/>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:ports>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:port uuid="af4682ae-3a41-498e-a6b5-90e3492b5e80">
Aug 17 16:25:58 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 16:25:58 user nova-compute[72724]:         </nova:port>
Aug 17 16:25:58 user nova-compute[72724]:       </nova:ports>
Aug 17 16:25:58 user nova-compute[72724]:     </nova:instance>
Aug 17 16:25:58 user nova-compute[72724]:   </metadata>
Aug 17 16:25:58 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:25:58 user nova-compute[72724]:     <system>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="serial">254406ea-145e-40ff-8252-9e4a28db4892</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="uuid">254406ea-145e-40ff-8252-9e4a28db4892</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:25:58 user nova-compute[72724]:     </system>
Aug 17 16:25:58 user nova-compute[72724]:   </sysinfo>
Aug 17 16:25:58 user nova-compute[72724]:   <os>
Aug 17 16:25:58 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:25:58 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:25:58 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:25:58 user nova-compute[72724]:   </os>
Aug 17 16:25:58 user nova-compute[72724]:   <features>
Aug 17 16:25:58 user nova-compute[72724]:     <acpi/>
Aug 17 16:25:58 user nova-compute[72724]:     <apic/>
Aug 17 16:25:58 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:25:58 user nova-compute[72724]:   </features>
Aug 17 16:25:58 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:25:58 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:25:58 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:25:58 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:25:58 user nova-compute[72724]:   </clock>
Aug 17 16:25:58 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:25:58 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:25:58 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:25:58 user nova-compute[72724]:   </cpu>
Aug 17 16:25:58 user nova-compute[72724]:   <devices>
Aug 17 16:25:58 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:25:58 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:25:58 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk"/>
Aug 17 16:25:58 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:     </disk>
Aug 17 16:25:58 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:25:58 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:25:58 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:25:58 user nova-compute[72724]:       <target dev="vdc" bus="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:       <serial>39ac30ff-b1c2-4dfb-8d57-070e8558fb2a</serial>
Aug 17 16:25:58 user nova-compute[72724]:     </disk>
Aug 17 16:25:58 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:25:58 user nova-compute[72724]:       <mac address="fa:16:3e:9b:3b:75"/>
Aug 17 16:25:58 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:25:58 user nova-compute[72724]:       <target dev="tapaf4682ae-3a"/>
Aug 17 16:25:58 user nova-compute[72724]:     </interface>
Aug 17 16:25:58 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:25:58 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/console.log" append="off"/>
Aug 17 16:25:58 user nova-compute[72724]:     </serial>
Aug 17 16:25:58 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:25:58 user nova-compute[72724]:     <video>
Aug 17 16:25:58 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:     </video>
Aug 17 16:25:58 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:25:58 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:25:58 user nova-compute[72724]:     </rng>
Aug 17 16:25:58 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:25:58 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:25:58 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:25:58 user nova-compute[72724]:     </memballoon>
Aug 17 16:25:58 user nova-compute[72724]:   </devices>
Aug 17 16:25:58 user nova-compute[72724]: </domain>
Aug 17 16:25:58 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-598960467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-598960467',id=3,image_ref='c1280c96-2a67-4163-84fb-5904e2cb96c8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-513051232',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-o12a1ie6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member',shelved_at='2023-08-17T16:23:47.659480',shelved_host='user',shelved_image_id='c1280c96-2a67-4163-84fb-5904e2cb96c8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:25:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=254406ea-145e-40ff-8252-9e4a28db4892,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG os_vif [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf4682ae-3a, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaf4682ae-3a, col_values=(('external_ids', {'iface-id': 'af4682ae-3a41-498e-a6b5-90e3492b5e80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:3b:75', 'vm-uuid': '254406ea-145e-40ff-8252-9e4a28db4892'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: INFO os_vif [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a')
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updating instance_info_cache with network_info: [{"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Releasing lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Instance network_info: |[{"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] Acquired lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.neutron [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Refreshing network info cache for port 9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Start _get_guest_xml network_info=[{"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:58 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No VIF found with MAC fa:16:3e:9b:3b:75, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1472458338',display_name='tempest-TestVolumeSwap-server-1472458338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1472458338',id=12,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFou61sZJpy2xjt9YI2s8qLSUYUi4fWtullLssbKbPuJxuVo4ZVDSl7neDNiDjpeDcc9B9XXwVuSxveUrViocMZVFtsEqh+Qr0xQlSAVwdFb4CKgZC7qicvN2tl9I5luPg==',key_name='tempest-keypair-54243302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140ed8b03f1c405f893dea0fce1855a6',ramdisk_id='',reservation_id='r-sdistu53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2026026569',owner_user_name='tempest-TestVolumeSwap-2026026569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2156bdcb9f4e259b40ee4827796598',uuid=6d53a869-a011-47cc-ae06-9f499036bcc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Converting VIF {"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.objects.instance [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:25:58 user nova-compute[72724]:   <uuid>6d53a869-a011-47cc-ae06-9f499036bcc7</uuid>
Aug 17 16:25:58 user nova-compute[72724]:   <name>instance-0000000c</name>
Aug 17 16:25:58 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:25:58 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:25:58 user nova-compute[72724]:   <metadata>
Aug 17 16:25:58 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:25:58 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:name>tempest-TestVolumeSwap-server-1472458338</nova:name>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:25:58</nova:creationTime>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:25:58 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:25:58 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:owner>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:user uuid="8d2156bdcb9f4e259b40ee4827796598">tempest-TestVolumeSwap-2026026569-project-member</nova:user>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:project uuid="140ed8b03f1c405f893dea0fce1855a6">tempest-TestVolumeSwap-2026026569</nova:project>
Aug 17 16:25:58 user nova-compute[72724]:       </nova:owner>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:25:58 user nova-compute[72724]:       <nova:ports>
Aug 17 16:25:58 user nova-compute[72724]:         <nova:port uuid="9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce">
Aug 17 16:25:58 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:25:58 user nova-compute[72724]:         </nova:port>
Aug 17 16:25:58 user nova-compute[72724]:       </nova:ports>
Aug 17 16:25:58 user nova-compute[72724]:     </nova:instance>
Aug 17 16:25:58 user nova-compute[72724]:   </metadata>
Aug 17 16:25:58 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:25:58 user nova-compute[72724]:     <system>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="serial">6d53a869-a011-47cc-ae06-9f499036bcc7</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="uuid">6d53a869-a011-47cc-ae06-9f499036bcc7</entry>
Aug 17 16:25:58 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:25:58 user nova-compute[72724]:     </system>
Aug 17 16:25:58 user nova-compute[72724]:   </sysinfo>
Aug 17 16:25:58 user nova-compute[72724]:   <os>
Aug 17 16:25:58 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:25:58 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:25:58 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:25:58 user nova-compute[72724]:   </os>
Aug 17 16:25:58 user nova-compute[72724]:   <features>
Aug 17 16:25:58 user nova-compute[72724]:     <acpi/>
Aug 17 16:25:58 user nova-compute[72724]:     <apic/>
Aug 17 16:25:58 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:25:58 user nova-compute[72724]:   </features>
Aug 17 16:25:58 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:25:58 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:25:58 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:25:58 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:25:58 user nova-compute[72724]:   </clock>
Aug 17 16:25:58 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:25:58 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:25:58 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:25:58 user nova-compute[72724]:   </cpu>
Aug 17 16:25:58 user nova-compute[72724]:   <devices>
Aug 17 16:25:58 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:25:58 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:25:58 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk"/>
Aug 17 16:25:58 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:     </disk>
Aug 17 16:25:58 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:25:58 user nova-compute[72724]:       <mac address="fa:16:3e:c7:65:9f"/>
Aug 17 16:25:58 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:25:58 user nova-compute[72724]:       <target dev="tap9a5b3c7d-02"/>
Aug 17 16:25:58 user nova-compute[72724]:     </interface>
Aug 17 16:25:58 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:25:58 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/console.log" append="off"/>
Aug 17 16:25:58 user nova-compute[72724]:     </serial>
Aug 17 16:25:58 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:25:58 user nova-compute[72724]:     <video>
Aug 17 16:25:58 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:25:58 user nova-compute[72724]:     </video>
Aug 17 16:25:58 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:25:58 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:25:58 user nova-compute[72724]:     </rng>
Aug 17 16:25:58 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:25:58 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:25:58 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:25:58 user nova-compute[72724]:     </memballoon>
Aug 17 16:25:58 user nova-compute[72724]:   </devices>
Aug 17 16:25:58 user nova-compute[72724]: </domain>
Aug 17 16:25:58 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1472458338',display_name='tempest-TestVolumeSwap-server-1472458338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1472458338',id=12,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFou61sZJpy2xjt9YI2s8qLSUYUi4fWtullLssbKbPuJxuVo4ZVDSl7neDNiDjpeDcc9B9XXwVuSxveUrViocMZVFtsEqh+Qr0xQlSAVwdFb4CKgZC7qicvN2tl9I5luPg==',key_name='tempest-keypair-54243302',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='140ed8b03f1c405f893dea0fce1855a6',ramdisk_id='',reservation_id='r-sdistu53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2026026569',owner_user_name='tempest-TestVolumeSwap-2026026569-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2156bdcb9f4e259b40ee4827796598',uuid=6d53a869-a011-47cc-ae06-9f499036bcc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Converting VIF {"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG os_vif [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a5b3c7d-02, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9a5b3c7d-02, col_values=(('external_ids', {'iface-id': '9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c7:65:9f', 'vm-uuid': '6d53a869-a011-47cc-ae06-9f499036bcc7'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:25:59 user nova-compute[72724]: INFO nova.compute.manager [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Took 2.83 seconds to detach 3 volumes for instance.
Aug 17 16:25:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:59 user nova-compute[72724]: INFO os_vif [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02')
Aug 17 16:25:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] No VIF found with MAC fa:16:3e:c7:65:9f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-ae01c189-8507-462e-9590-fd829544bd96 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:25:59 user nova-compute[72724]: WARNING nova.compute.manager [req-0de6bc2f-dde4-44e4-8717-fdca557aaf36 req-6bb33a89-df9e-4313-993b-5a6a45bb4952 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-ae01c189-8507-462e-9590-fd829544bd96 for instance with vm_state active and task_state deleting.
Aug 17 16:25:59 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Deleted allocations for instance de3f1276-aa06-4843-a69a-165a7c624f8f
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updated VIF entry in instance network info cache for port 9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updating instance_info_cache with network_info: [{"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e7cb0faa-e68d-4935-a378-66890ffbe0ef req-9ab6931b-12cd-47c3-9b64-3b44f0cca5e9 service nova] Releasing lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:25:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b0be3ff4-f7dd-4cc9-9051-f411b20c187b tempest-TaggedBootDevicesTest-1054668907 tempest-TaggedBootDevicesTest-1054668907-project-member] Lock "de3f1276-aa06-4843-a69a-165a7c624f8f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.496s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-30053a0b-9af1-4a83-b2fb-aeef68758317 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: WARNING nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-30053a0b-9af1-4a83-b2fb-aeef68758317 for instance with vm_state active and task_state deleting.
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: WARNING nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-35d9f38e-21cb-4b84-9ca1-70bf70001b23 for instance with vm_state active and task_state deleting.
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: WARNING nova.compute.manager [req-0d3b4937-c7a5-43ee-be0c-53da7c200602 req-8e870054-f3bf-4c46-9f25-914beaec554e service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 for instance with vm_state active and task_state deleting.
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-fcd42c3c-e0eb-43bb-9686-e79bbb4e28cc req-d42602e3-dff5-434e-bf27-1fb12c7b881c service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fcd42c3c-e0eb-43bb-9686-e79bbb4e28cc req-d42602e3-dff5-434e-bf27-1fb12c7b881c service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fcd42c3c-e0eb-43bb-9686-e79bbb4e28cc req-d42602e3-dff5-434e-bf27-1fb12c7b881c service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fcd42c3c-e0eb-43bb-9686-e79bbb4e28cc req-d42602e3-dff5-434e-bf27-1fb12c7b881c service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-fcd42c3c-e0eb-43bb-9686-e79bbb4e28cc req-d42602e3-dff5-434e-bf27-1fb12c7b881c service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:00 user nova-compute[72724]: WARNING nova.compute.manager [req-fcd42c3c-e0eb-43bb-9686-e79bbb4e28cc req-d42602e3-dff5-434e-bf27-1fb12c7b881c service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-c9d0e07d-2f62-4841-b85e-264704ad8a36 for instance with vm_state active and task_state deleting.
Aug 17 16:26:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Instance destroyed successfully.
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lazy-loading 'resources' on Instance uuid 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30053a0b-9a, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:d6:c7,bridge_name='br-int',has_traffic_filtering=True,id=30053a0b-9af1-4a83-b2fb-aeef68758317,network=Network(1d8adf6b-af85-4439-94d7-a717eaa29f67),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30053a0b-9a')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d0e07d-2f, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:1d:71,bridge_name='br-int',has_traffic_filtering=True,id=c9d0e07d-2f62-4841-b85e-264704ad8a36,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc9d0e07d-2f')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap35d9f38e-21, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:d7:0d,bridge_name='br-int',has_traffic_filtering=True,id=35d9f38e-21cb-4b84-9ca1-70bf70001b23,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap35d9f38e-21')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap81abc5ef-57, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:37:cd,bridge_name='br-int',has_traffic_filtering=True,id=81abc5ef-5731-40b6-92e1-9f92ecfbfcc1,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap81abc5ef-57')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41d6bc13-9f, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:a0:d2,bridge_name='br-int',has_traffic_filtering=True,id=41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4,network=Network(5ecc21c4-32ce-42d3-85b0-a6929aafd0b4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41d6bc13-9f')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "ae01c189-8507-462e-9590-fd829544bd96", "address": "fa:16:3e:71:8a:3f", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae01c189-85", "ovs_interfaceid": "ae01c189-8507-462e-9590-fd829544bd96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae01c189-85, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:8a:3f,bridge_name='br-int',has_traffic_filtering=True,id=ae01c189-8507-462e-9590-fd829544bd96,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae01c189-85')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-17T16:23:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1087705874',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1087705874',id=9,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtqT8BryIkFAXqPHSKNLYjA+doK1guamBBEuJMgCTaacDntx5SetAA0vyopyeLwHk1TjXccpJlteHDayUk+/8p7Osh99JWqE9FCcjgYSLeqB1jX5dOBfisQpcRk8zuIhg==',key_name='tempest-keypair-1126334394',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5dbe91ac114e41c3b78db18dbf445d00',ramdisk_id='',reservation_id='r-r5z5di76',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-163224499',owner_user_name='tempest-TaggedBootDevicesTest_v242-163224499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5cd148f811734a8db6c8658ecc00caf5',uuid=32ed3fdd-0833-44a4-b302-8a6ad3b9c15f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converting VIF {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd780aa98-e0, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: INFO os_vif [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:c7:93,bridge_name='br-int',has_traffic_filtering=True,id=d780aa98-e043-4055-8af9-1f52567806c5,network=Network(db6ecabb-d439-4630-b470-b54b09bb0a09),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd780aa98-e0')
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QIijdMLV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:26:01 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af76ae2-b52d-43f1-a3e5-3825518dd3c9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04cbe225-5a22-4327-8bbe-eb4d2a21ae49]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86eead8160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b'): ({'sdf'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Removing single pathed devices sdf {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[61903520-2c00-4046-9cdf-dde3b9cf7b91]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb7b822-c749-4981-bffd-1370aefcdf29]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Flushing IO for device /dev/sdf {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e716e3-ef6f-4775-aa09-c6675a38aa0e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b557c8de-793e-4d30-9cd5-8a0b3412737c]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] SCSI volumes sdf have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[86cbda32-afe6-4bf1-92d5-355ce34b8c71]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d3ffc3-13be-42a4-b79c-4b51c4d4d011]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260]
Aug 17 16:26:01 user nova-compute[72724]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b, portal: 172.16.0.220,3260] successful.
Aug 17 16:26:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:039bd2db-7ceb-401c-a10b-4cd8bcfcd97b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d94bbd-366f-406c-bfb6-27c1bad2ac2a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== disconnect_volume: return (365ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JyfzCGqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:26:01 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e6be2-95ee-436b-a1d5-2c75615bfe1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46834df-a5f2-44f0-bdfe-fb1eeb8142e3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 (non-flash)
Aug 17 16:26:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e82dcdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4'): ({'sdg'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Removing single pathed devices sdg {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-5119b221-cc52-4126-9e99-3af78ee36761 req-a59eb50e-ffe4-4b3d-87b3-3b747d5ff892 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5119b221-cc52-4126-9e99-3af78ee36761 req-a59eb50e-ffe4-4b3d-87b3-3b747d5ff892 service nova] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5119b221-cc52-4126-9e99-3af78ee36761 req-a59eb50e-ffe4-4b3d-87b3-3b747d5ff892 service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5119b221-cc52-4126-9e99-3af78ee36761 req-a59eb50e-ffe4-4b3d-87b3-3b747d5ff892 service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-5119b221-cc52-4126-9e99-3af78ee36761 req-a59eb50e-ffe4-4b3d-87b3-3b747d5ff892 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] No waiting events found dispatching network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:01 user nova-compute[72724]: WARNING nova.compute.manager [req-5119b221-cc52-4126-9e99-3af78ee36761 req-a59eb50e-ffe4-4b3d-87b3-3b747d5ff892 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received unexpected event network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce for instance with vm_state building and task_state spawning.
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05a9ec0-7a2e-474a-97a0-2c796fa5b56e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d428ab84-e517-46e3-ba11-270cdefff52a]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Flushing IO for device /dev/sdg {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:26:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6806b5d1-0235-4588-b800-55fa8f29212b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6176a9-4d94-4471-87b3-012de0580a45]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] SCSI volumes sdg have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d405c-93db-4465-8157-ac7bd88c239a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:02 user nova-compute[72724]: WARNING nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 for instance with vm_state active and task_state deleting.
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-unplugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-unplugged-d780aa98-e043-4055-8af9-1f52567806c5 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Acquiring lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] No waiting events found dispatching network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:02 user nova-compute[72724]: WARNING nova.compute.manager [req-549f0d33-48d5-4526-a4ff-623fcb7155d0 req-2062c63a-f817-46ba-b2ef-274695051f92 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received unexpected event network-vif-plugged-d780aa98-e043-4055-8af9-1f52567806c5 for instance with vm_state active and task_state deleting.
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e404d-4824-46c6-993f-df81570f1718]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260]
Aug 17 16:26:02 user nova-compute[72724]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4, portal: 172.16.0.220,3260] successful.
Aug 17 16:26:02 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1ebaccc2-f3b6-4c7d-b876-a7600cbd6ea4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe415e0-5041-4ae6-81cf-b9899c8b8725]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== disconnect_volume: return (388ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IupchVKU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:26:02 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd888e1-29bc-40b3-a333-ea78dd41f952]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6c6d16-f135-481b-923c-49146b080ff0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:26:02 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:26:02 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:26:02 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:26:02 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:26:02 user nova-compute[72724]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 (non-flash)
Aug 17 16:26:02 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c868e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4'): ({'sde'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Removing single pathed devices sde {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a19d66-9db4-485b-a29f-9edd859818e6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[46160b7a-4078-4ae9-ad3f-17778a9cf4c0]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Flushing IO for device /dev/sde {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40cdb648-3d14-42ff-a938-b2b8cfc20893]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7669ad0-4431-45a8-9af7-e29646ce20f4]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] SCSI volumes sde have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:02 user nova-compute[72724]: WARNING nova.compute.manager [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:02 user nova-compute[72724]: WARNING nova.compute.manager [req-c5c0e569-c091-460f-90d7-c25f4258ae85 req-83eefa4c-91eb-4afb-92d5-c6c83e3eab0f service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d0fe5e-651b-4d32-9c55-7ee62da9f265]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f05df-b358-4273-b2a4-ed95d0026e06]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260]
Aug 17 16:26:02 user nova-compute[72724]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4, portal: 172.16.0.220,3260] successful.
Aug 17 16:26:02 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a80512a0-9b4d-4253-9b4b-7ab8fc6ce1b4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0d87c7-06e7-45bf-97d8-613bb657daaf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] <== disconnect_volume: return (365ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:26:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Deleting instance files /opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f_del
Aug 17 16:26:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Deletion of /opt/stack/data/nova/instances/32ed3fdd-0833-44a4-b302-8a6ad3b9c15f_del complete
Aug 17 16:26:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:02 user nova-compute[72724]: INFO nova.compute.manager [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Took 5.07 seconds to destroy the instance on the hypervisor.
Aug 17 16:26:02 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:26:02 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:26:03 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289548.082187, de3f1276-aa06-4843-a69a-165a7c624f8f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:03 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] VM Stopped (Lifecycle Event)
Aug 17 16:26:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f06c9c9d-ea7e-4710-b8bc-ba6b4faedde8 None None] [instance: de3f1276-aa06-4843-a69a-165a7c624f8f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-8664bfd6-6a67-41e9-8ad7-4520361c6c0f req-39eabf8b-0e0c-489c-82aa-b97d27f253be service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8664bfd6-6a67-41e9-8ad7-4520361c6c0f req-39eabf8b-0e0c-489c-82aa-b97d27f253be service nova] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8664bfd6-6a67-41e9-8ad7-4520361c6c0f req-39eabf8b-0e0c-489c-82aa-b97d27f253be service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8664bfd6-6a67-41e9-8ad7-4520361c6c0f req-39eabf8b-0e0c-489c-82aa-b97d27f253be service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-8664bfd6-6a67-41e9-8ad7-4520361c6c0f req-39eabf8b-0e0c-489c-82aa-b97d27f253be service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] No waiting events found dispatching network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:03 user nova-compute[72724]: WARNING nova.compute.manager [req-8664bfd6-6a67-41e9-8ad7-4520361c6c0f req-39eabf8b-0e0c-489c-82aa-b97d27f253be service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received unexpected event network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce for instance with vm_state building and task_state spawning.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289564.1933076, 6d53a869-a011-47cc-ae06-9f499036bcc7 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] VM Resumed (Lifecycle Event)
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance spawned successfully.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Instance spawned successfully.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289564.1934507, 254406ea-145e-40ff-8252-9e4a28db4892 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] VM Resumed (Lifecycle Event)
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289564.2222526, 254406ea-145e-40ff-8252-9e4a28db4892 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] VM Started (Lifecycle Event)
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289564.222366, 6d53a869-a011-47cc-ae06-9f499036bcc7 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] VM Started (Lifecycle Event)
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Took 8.15 seconds to spawn the instance on the hypervisor.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:04 user nova-compute[72724]: INFO nova.compute.manager [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Took 9.33 seconds to build instance.
Aug 17 16:26:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-db26e48f-9ced-4833-bb6a-10838d06b467 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.426s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69237d7b-c4a3-4265-aa8d-aa360017f741 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 28.948s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-5fe6b904-dd9e-406e-8f57-29b94bf81f6b req-af95e56d-655c-448b-b718-f50e17058e62 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-deleted-ae01c189-8507-462e-9590-fd829544bd96 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:06 user nova-compute[72724]: INFO nova.compute.manager [req-5fe6b904-dd9e-406e-8f57-29b94bf81f6b req-af95e56d-655c-448b-b718-f50e17058e62 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Neutron deleted interface ae01c189-8507-462e-9590-fd829544bd96; detaching it from the instance and deleting it from the info cache
Aug 17 16:26:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-5fe6b904-dd9e-406e-8f57-29b94bf81f6b req-af95e56d-655c-448b-b718-f50e17058e62 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "30053a0b-9af1-4a83-b2fb-aeef68758317", "address": "fa:16:3e:b7:d6:c7", "network": {"id": "1d8adf6b-af85-4439-94d7-a717eaa29f67", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-555509128-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.78", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30053a0b-9a", "ovs_interfaceid": "30053a0b-9af1-4a83-b2fb-aeef68758317", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-5fe6b904-dd9e-406e-8f57-29b94bf81f6b req-af95e56d-655c-448b-b718-f50e17058e62 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Detach interface failed, port_id=ae01c189-8507-462e-9590-fd829544bd96, reason: Instance 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:26:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-960f92a5-8c71-4f1d-94bf-20ebc0bbfc90 req-6500b8c8-8ce2-4b86-96f8-2cca4fc94cb3 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-deleted-30053a0b-9af1-4a83-b2fb-aeef68758317 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:09 user nova-compute[72724]: INFO nova.compute.manager [req-960f92a5-8c71-4f1d-94bf-20ebc0bbfc90 req-6500b8c8-8ce2-4b86-96f8-2cca4fc94cb3 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Neutron deleted interface 30053a0b-9af1-4a83-b2fb-aeef68758317; detaching it from the instance and deleting it from the info cache
Aug 17 16:26:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-960f92a5-8c71-4f1d-94bf-20ebc0bbfc90 req-6500b8c8-8ce2-4b86-96f8-2cca4fc94cb3 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [{"id": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "address": "fa:16:3e:58:1d:71", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d0e07d-2f", "ovs_interfaceid": "c9d0e07d-2f62-4841-b85e-264704ad8a36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "address": "fa:16:3e:db:d7:0d", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.213", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap35d9f38e-21", "ovs_interfaceid": "35d9f38e-21cb-4b84-9ca1-70bf70001b23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "address": "fa:16:3e:a9:37:cd", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap81abc5ef-57", "ovs_interfaceid": "81abc5ef-5731-40b6-92e1-9f92ecfbfcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "address": "fa:16:3e:f6:a0:d2", "network": {"id": "5ecc21c4-32ce-42d3-85b0-a6929aafd0b4", "bridge": "br-int", "label": "tempest-device-tagging-net1-339171198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41d6bc13-9f", "ovs_interfaceid": "41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d780aa98-e043-4055-8af9-1f52567806c5", "address": "fa:16:3e:3d:c7:93", "network": {"id": "db6ecabb-d439-4630-b470-b54b09bb0a09", "bridge": "br-int", "label": "tempest-device-tagging-net2-1047498655", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "5dbe91ac114e41c3b78db18dbf445d00", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd780aa98-e0", "ovs_interfaceid": "d780aa98-e043-4055-8af9-1f52567806c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-960f92a5-8c71-4f1d-94bf-20ebc0bbfc90 req-6500b8c8-8ce2-4b86-96f8-2cca4fc94cb3 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Detach interface failed, port_id=30053a0b-9af1-4a83-b2fb-aeef68758317, reason: Instance 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:26:10 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:10 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Took 7.20 seconds to deallocate network for instance.
Aug 17 16:26:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-a8ba6ff1-ce9f-4170-a62d-fa29a446d04f req-26cd7115-cbb8-4ae7-9ec8-35fd4b1431d9 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-deleted-81abc5ef-5731-40b6-92e1-9f92ecfbfcc1 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-a8ba6ff1-ce9f-4170-a62d-fa29a446d04f req-26cd7115-cbb8-4ae7-9ec8-35fd4b1431d9 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-deleted-41d6bc13-9f1d-4c8a-95db-0bdec73f4fd4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-a8ba6ff1-ce9f-4170-a62d-fa29a446d04f req-26cd7115-cbb8-4ae7-9ec8-35fd4b1431d9 service nova] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Received event network-vif-deleted-d780aa98-e043-4055-8af9-1f52567806c5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:12 user nova-compute[72724]: INFO nova.compute.manager [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Took 2.78 seconds to detach 3 volumes for instance.
Aug 17 16:26:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:26:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:26:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:13 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Deleted allocations for instance 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f
Aug 17 16:26:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5801b236-fb6c-42a9-9712-794ddba7f29a tempest-TaggedBootDevicesTest_v242-163224499 tempest-TaggedBootDevicesTest_v242-163224499-project-member] Lock "32ed3fdd-0833-44a4-b302-8a6ad3b9c15f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 15.747s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:16 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289560.9969485, 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:16 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] VM Stopped (Lifecycle Event)
Aug 17 16:26:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a61f7e75-4d3a-4a4b-a39f-ef0416f7b1da None None] [instance: 32ed3fdd-0833-44a4-b302-8a6ad3b9c15f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:26:24 user nova-compute[72724]: INFO nova.compute.claims [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Claim successful on node user
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:26:24 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:26:24 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Creating image(s)
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "/opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "/opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.219s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk 1073741824" returned: 0 in 0.049s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG nova.policy [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df91a9dc8e5b49f3bf2188ab3a96b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa57b31426d46ad8fa5351fe3ebb91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Cannot resize image /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lazy-loading 'migration_context' on Instance uuid 7e5312b5-8900-4739-a8a6-06efbcbc819c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Ensure instance console log exists: /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:26 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Successfully created port: 487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Successfully updated port: 487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquired lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-changed-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Refreshing instance network info cache due to event network-changed-487292e2-e6a2-4afd-a830-ef43137b9e97. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] Acquiring lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:27 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updating instance_info_cache with network_info: [{"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Releasing lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Instance network_info: |[{"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] Acquired lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.neutron [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Refreshing network info cache for port 487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Start _get_guest_xml network_info=[{"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:26:28 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:28 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-327932910',display_name='tempest-ServersNegativeTestJSON-server-327932910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-327932910',id=13,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa57b31426d46ad8fa5351fe3ebb91e',ramdisk_id='',reservation_id='r-tluxx9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-566124124',owner_user_name='tempest-ServersNegativeTestJSON-566124124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:25Z,user_data=None,user_id='df91a9dc8e5b49f3bf2188ab3a96b1e8',uuid=7e5312b5-8900-4739-a8a6-06efbcbc819c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converting VIF {"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e5312b5-8900-4739-a8a6-06efbcbc819c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:26:28 user nova-compute[72724]:   <uuid>7e5312b5-8900-4739-a8a6-06efbcbc819c</uuid>
Aug 17 16:26:28 user nova-compute[72724]:   <name>instance-0000000d</name>
Aug 17 16:26:28 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:26:28 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:26:28 user nova-compute[72724]:   <metadata>
Aug 17 16:26:28 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:26:28 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:26:28 user nova-compute[72724]:       <nova:name>tempest-ServersNegativeTestJSON-server-327932910</nova:name>
Aug 17 16:26:28 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:26:28</nova:creationTime>
Aug 17 16:26:28 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:26:28 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:26:28 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:26:28 user nova-compute[72724]:       <nova:owner>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:user uuid="df91a9dc8e5b49f3bf2188ab3a96b1e8">tempest-ServersNegativeTestJSON-566124124-project-member</nova:user>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:project uuid="5fa57b31426d46ad8fa5351fe3ebb91e">tempest-ServersNegativeTestJSON-566124124</nova:project>
Aug 17 16:26:28 user nova-compute[72724]:       </nova:owner>
Aug 17 16:26:28 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:26:28 user nova-compute[72724]:       <nova:ports>
Aug 17 16:26:28 user nova-compute[72724]:         <nova:port uuid="487292e2-e6a2-4afd-a830-ef43137b9e97">
Aug 17 16:26:28 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:26:28 user nova-compute[72724]:         </nova:port>
Aug 17 16:26:28 user nova-compute[72724]:       </nova:ports>
Aug 17 16:26:28 user nova-compute[72724]:     </nova:instance>
Aug 17 16:26:28 user nova-compute[72724]:   </metadata>
Aug 17 16:26:28 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:26:28 user nova-compute[72724]:     <system>
Aug 17 16:26:28 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:26:28 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:26:28 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:26:28 user nova-compute[72724]:       <entry name="serial">7e5312b5-8900-4739-a8a6-06efbcbc819c</entry>
Aug 17 16:26:28 user nova-compute[72724]:       <entry name="uuid">7e5312b5-8900-4739-a8a6-06efbcbc819c</entry>
Aug 17 16:26:28 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:26:28 user nova-compute[72724]:     </system>
Aug 17 16:26:28 user nova-compute[72724]:   </sysinfo>
Aug 17 16:26:28 user nova-compute[72724]:   <os>
Aug 17 16:26:28 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:26:28 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:26:28 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:26:28 user nova-compute[72724]:   </os>
Aug 17 16:26:28 user nova-compute[72724]:   <features>
Aug 17 16:26:28 user nova-compute[72724]:     <acpi/>
Aug 17 16:26:28 user nova-compute[72724]:     <apic/>
Aug 17 16:26:28 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:26:28 user nova-compute[72724]:   </features>
Aug 17 16:26:28 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:26:28 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:26:28 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:26:28 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:26:28 user nova-compute[72724]:   </clock>
Aug 17 16:26:28 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:26:28 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:26:28 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:26:28 user nova-compute[72724]:   </cpu>
Aug 17 16:26:28 user nova-compute[72724]:   <devices>
Aug 17 16:26:28 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:26:28 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:26:28 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk"/>
Aug 17 16:26:28 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:26:28 user nova-compute[72724]:     </disk>
Aug 17 16:26:28 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:26:28 user nova-compute[72724]:       <mac address="fa:16:3e:43:c2:a0"/>
Aug 17 16:26:28 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:26:28 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:26:28 user nova-compute[72724]:       <target dev="tap487292e2-e6"/>
Aug 17 16:26:28 user nova-compute[72724]:     </interface>
Aug 17 16:26:28 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:26:28 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/console.log" append="off"/>
Aug 17 16:26:28 user nova-compute[72724]:     </serial>
Aug 17 16:26:28 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:26:28 user nova-compute[72724]:     <video>
Aug 17 16:26:28 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:26:28 user nova-compute[72724]:     </video>
Aug 17 16:26:28 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:26:28 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:26:28 user nova-compute[72724]:     </rng>
Aug 17 16:26:28 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:26:28 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:26:28 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:26:28 user nova-compute[72724]:     </memballoon>
Aug 17 16:26:28 user nova-compute[72724]:   </devices>
Aug 17 16:26:28 user nova-compute[72724]: </domain>
Aug 17 16:26:28 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-327932910',display_name='tempest-ServersNegativeTestJSON-server-327932910',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-327932910',id=13,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa57b31426d46ad8fa5351fe3ebb91e',ramdisk_id='',reservation_id='r-tluxx9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-566124124',owner_user_name='tempest-ServersNegativeTestJSON-566124124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:25Z,user_data=None,user_id='df91a9dc8e5b49f3bf2188ab3a96b1e8',uuid=7e5312b5-8900-4739-a8a6-06efbcbc819c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converting VIF {"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG os_vif [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap487292e2-e6, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap487292e2-e6, col_values=(('external_ids', {'iface-id': '487292e2-e6a2-4afd-a830-ef43137b9e97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:c2:a0', 'vm-uuid': '7e5312b5-8900-4739-a8a6-06efbcbc819c'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:28 user nova-compute[72724]: INFO os_vif [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6')
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] No VIF found with MAC fa:16:3e:43:c2:a0, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.neutron [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updated VIF entry in instance network info cache for port 487292e2-e6a2-4afd-a830-ef43137b9e97. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG nova.network.neutron [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updating instance_info_cache with network_info: [{"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-da06ce25-7614-4197-84e2-79ca7ce00876 req-d0a22f8f-73cc-4589-819b-f73f9fdf4ee5 service nova] Releasing lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-13dba7e2-6809-4500-bf04-d5d077cdf182 req-b6b0f335-4446-49c5-ba5e-493a77ea4b7e service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-13dba7e2-6809-4500-bf04-d5d077cdf182 req-b6b0f335-4446-49c5-ba5e-493a77ea4b7e service nova] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-13dba7e2-6809-4500-bf04-d5d077cdf182 req-b6b0f335-4446-49c5-ba5e-493a77ea4b7e service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-13dba7e2-6809-4500-bf04-d5d077cdf182 req-b6b0f335-4446-49c5-ba5e-493a77ea4b7e service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-13dba7e2-6809-4500-bf04-d5d077cdf182 req-b6b0f335-4446-49c5-ba5e-493a77ea4b7e service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] No waiting events found dispatching network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:30 user nova-compute[72724]: WARNING nova.compute.manager [req-13dba7e2-6809-4500-bf04-d5d077cdf182 req-b6b0f335-4446-49c5-ba5e-493a77ea4b7e service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received unexpected event network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 for instance with vm_state building and task_state spawning.
Aug 17 16:26:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:31 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289592.1086116, 7e5312b5-8900-4739-a8a6-06efbcbc819c => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] VM Resumed (Lifecycle Event)
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Instance spawned successfully.
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-90ae2bf8-374d-420c-aefd-fa5375a2dcab req-d2ebbf77-7275-44ee-8fe4-7799c7c3d0ab service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-90ae2bf8-374d-420c-aefd-fa5375a2dcab req-d2ebbf77-7275-44ee-8fe4-7799c7c3d0ab service nova] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-90ae2bf8-374d-420c-aefd-fa5375a2dcab req-d2ebbf77-7275-44ee-8fe4-7799c7c3d0ab service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-90ae2bf8-374d-420c-aefd-fa5375a2dcab req-d2ebbf77-7275-44ee-8fe4-7799c7c3d0ab service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-90ae2bf8-374d-420c-aefd-fa5375a2dcab req-d2ebbf77-7275-44ee-8fe4-7799c7c3d0ab service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] No waiting events found dispatching network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:32 user nova-compute[72724]: WARNING nova.compute.manager [req-90ae2bf8-374d-420c-aefd-fa5375a2dcab req-d2ebbf77-7275-44ee-8fe4-7799c7c3d0ab service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received unexpected event network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 for instance with vm_state building and task_state spawning.
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289592.112484, 7e5312b5-8900-4739-a8a6-06efbcbc819c => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] VM Started (Lifecycle Event)
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Took 7.29 seconds to spawn the instance on the hypervisor.
Aug 17 16:26:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:32 user nova-compute[72724]: INFO nova.compute.manager [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Took 7.98 seconds to build instance.
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b7fd3e8f-6d23-408a-9966-0342b2ea21da tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.065s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.405s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:26:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7828MB free_disk=25.691505432128906GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 75fd7469-8155-43cf-a93c-fac4132c8f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 621f2153-b6a5-4697-868b-39681372ff2f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 254406ea-145e-40ff-8252-9e4a28db4892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6d53a869-a011-47cc-ae06-9f499036bcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:26:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:26:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:26:40 user nova-compute[72724]: INFO nova.compute.claims [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Claim successful on node user
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.400s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:26:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:26:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Creating image(s)
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.policy [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '558eaa9f170b40978f6004f1e6aff3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4767040317048ddb4479fa7c82f3384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:26:41 user nova-compute[72724]: INFO nova.compute.claims [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Claim successful on node user
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.167s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk 1073741824" returned: 0 in 0.054s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Successfully created port: dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:26:41 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.580s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Cannot resize image /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.objects.instance [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'migration_context' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Ensure instance console log exists: /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:26:42 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.policy [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '558eaa9f170b40978f6004f1e6aff3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4767040317048ddb4479fa7c82f3384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:26:42 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Creating image(s)
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk 1073741824" returned: 0 in 0.055s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Successfully created port: 853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Successfully updated port: dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-changed-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Refreshing instance network info cache due to event network-changed-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:26:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Cannot resize image /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'migration_context' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Ensure instance console log exists: /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance network_info: |[{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Refreshing network info cache for port dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Start _get_guest_xml network_info=[{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:26:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-697311111',display_name='tempest-ServerRescueNegativeTestJSON-server-697311111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-697311111',id=14,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-rytohmqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:41Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=f09067a8-3cf3-4fe7-aa75-78348da59adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.objects.instance [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'pci_devices' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:26:43 user nova-compute[72724]:   <uuid>f09067a8-3cf3-4fe7-aa75-78348da59adb</uuid>
Aug 17 16:26:43 user nova-compute[72724]:   <name>instance-0000000e</name>
Aug 17 16:26:43 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:26:43 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:26:43 user nova-compute[72724]:   <metadata>
Aug 17 16:26:43 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:26:43 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:26:43 user nova-compute[72724]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-697311111</nova:name>
Aug 17 16:26:43 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:26:43</nova:creationTime>
Aug 17 16:26:43 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:26:43 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:26:43 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:26:43 user nova-compute[72724]:       <nova:owner>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:user uuid="558eaa9f170b40978f6004f1e6aff3e9">tempest-ServerRescueNegativeTestJSON-2097085369-project-member</nova:user>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:project uuid="c4767040317048ddb4479fa7c82f3384">tempest-ServerRescueNegativeTestJSON-2097085369</nova:project>
Aug 17 16:26:43 user nova-compute[72724]:       </nova:owner>
Aug 17 16:26:43 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:26:43 user nova-compute[72724]:       <nova:ports>
Aug 17 16:26:43 user nova-compute[72724]:         <nova:port uuid="dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9">
Aug 17 16:26:43 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:26:43 user nova-compute[72724]:         </nova:port>
Aug 17 16:26:43 user nova-compute[72724]:       </nova:ports>
Aug 17 16:26:43 user nova-compute[72724]:     </nova:instance>
Aug 17 16:26:43 user nova-compute[72724]:   </metadata>
Aug 17 16:26:43 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:26:43 user nova-compute[72724]:     <system>
Aug 17 16:26:43 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:26:43 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:26:43 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:26:43 user nova-compute[72724]:       <entry name="serial">f09067a8-3cf3-4fe7-aa75-78348da59adb</entry>
Aug 17 16:26:43 user nova-compute[72724]:       <entry name="uuid">f09067a8-3cf3-4fe7-aa75-78348da59adb</entry>
Aug 17 16:26:43 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:26:43 user nova-compute[72724]:     </system>
Aug 17 16:26:43 user nova-compute[72724]:   </sysinfo>
Aug 17 16:26:43 user nova-compute[72724]:   <os>
Aug 17 16:26:43 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:26:43 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:26:43 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:26:43 user nova-compute[72724]:   </os>
Aug 17 16:26:43 user nova-compute[72724]:   <features>
Aug 17 16:26:43 user nova-compute[72724]:     <acpi/>
Aug 17 16:26:43 user nova-compute[72724]:     <apic/>
Aug 17 16:26:43 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:26:43 user nova-compute[72724]:   </features>
Aug 17 16:26:43 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:26:43 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:26:43 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:26:43 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:26:43 user nova-compute[72724]:   </clock>
Aug 17 16:26:43 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:26:43 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:26:43 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:26:43 user nova-compute[72724]:   </cpu>
Aug 17 16:26:43 user nova-compute[72724]:   <devices>
Aug 17 16:26:43 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:26:43 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:26:43 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk"/>
Aug 17 16:26:43 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:26:43 user nova-compute[72724]:     </disk>
Aug 17 16:26:43 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:26:43 user nova-compute[72724]:       <mac address="fa:16:3e:03:95:21"/>
Aug 17 16:26:43 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:26:43 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:26:43 user nova-compute[72724]:       <target dev="tapdbac9e36-0f"/>
Aug 17 16:26:43 user nova-compute[72724]:     </interface>
Aug 17 16:26:43 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:26:43 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/console.log" append="off"/>
Aug 17 16:26:43 user nova-compute[72724]:     </serial>
Aug 17 16:26:43 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:26:43 user nova-compute[72724]:     <video>
Aug 17 16:26:43 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:26:43 user nova-compute[72724]:     </video>
Aug 17 16:26:43 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:26:43 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:26:43 user nova-compute[72724]:     </rng>
Aug 17 16:26:43 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:26:43 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:26:43 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:26:43 user nova-compute[72724]:     </memballoon>
Aug 17 16:26:43 user nova-compute[72724]:   </devices>
Aug 17 16:26:43 user nova-compute[72724]: </domain>
Aug 17 16:26:43 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-697311111',display_name='tempest-ServerRescueNegativeTestJSON-server-697311111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-697311111',id=14,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-rytohmqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:41Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=f09067a8-3cf3-4fe7-aa75-78348da59adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG os_vif [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbac9e36-0f, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdbac9e36-0f, col_values=(('external_ids', {'iface-id': 'dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:95:21', 'vm-uuid': 'f09067a8-3cf3-4fe7-aa75-78348da59adb'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:43 user nova-compute[72724]: INFO os_vif [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f')
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:26:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:03:95:21, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Successfully updated port: 853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-changed-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Refreshing instance network info cache due to event network-changed-853dcaac-14ef-4365-9613-97c8afbbc55a. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] Acquiring lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updated VIF entry in instance network info cache for port dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-74eb43b6-1cd8-4003-8b92-7f68e6d00a0f req-64a000ab-d253-447f-9f00-ebdc62c00f20 service nova] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance network_info: |[{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] Acquired lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Refreshing network info cache for port 853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Start _get_guest_xml network_info=[{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:26:44 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:44 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220067116',display_name='tempest-ServerRescueNegativeTestJSON-server-220067116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220067116',id=15,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-c10ke00q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:42Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=59a5dee3-bf14-4196-a8da-c9ea471c0752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'pci_devices' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:26:44 user nova-compute[72724]:   <uuid>59a5dee3-bf14-4196-a8da-c9ea471c0752</uuid>
Aug 17 16:26:44 user nova-compute[72724]:   <name>instance-0000000f</name>
Aug 17 16:26:44 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:26:44 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:26:44 user nova-compute[72724]:   <metadata>
Aug 17 16:26:44 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:26:44 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:26:44 user nova-compute[72724]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-220067116</nova:name>
Aug 17 16:26:44 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:26:44</nova:creationTime>
Aug 17 16:26:44 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:26:44 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:26:44 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:26:44 user nova-compute[72724]:       <nova:owner>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:user uuid="558eaa9f170b40978f6004f1e6aff3e9">tempest-ServerRescueNegativeTestJSON-2097085369-project-member</nova:user>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:project uuid="c4767040317048ddb4479fa7c82f3384">tempest-ServerRescueNegativeTestJSON-2097085369</nova:project>
Aug 17 16:26:44 user nova-compute[72724]:       </nova:owner>
Aug 17 16:26:44 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:26:44 user nova-compute[72724]:       <nova:ports>
Aug 17 16:26:44 user nova-compute[72724]:         <nova:port uuid="853dcaac-14ef-4365-9613-97c8afbbc55a">
Aug 17 16:26:44 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:26:44 user nova-compute[72724]:         </nova:port>
Aug 17 16:26:44 user nova-compute[72724]:       </nova:ports>
Aug 17 16:26:44 user nova-compute[72724]:     </nova:instance>
Aug 17 16:26:44 user nova-compute[72724]:   </metadata>
Aug 17 16:26:44 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:26:44 user nova-compute[72724]:     <system>
Aug 17 16:26:44 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:26:44 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:26:44 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:26:44 user nova-compute[72724]:       <entry name="serial">59a5dee3-bf14-4196-a8da-c9ea471c0752</entry>
Aug 17 16:26:44 user nova-compute[72724]:       <entry name="uuid">59a5dee3-bf14-4196-a8da-c9ea471c0752</entry>
Aug 17 16:26:44 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:26:44 user nova-compute[72724]:     </system>
Aug 17 16:26:44 user nova-compute[72724]:   </sysinfo>
Aug 17 16:26:44 user nova-compute[72724]:   <os>
Aug 17 16:26:44 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:26:44 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:26:44 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:26:44 user nova-compute[72724]:   </os>
Aug 17 16:26:44 user nova-compute[72724]:   <features>
Aug 17 16:26:44 user nova-compute[72724]:     <acpi/>
Aug 17 16:26:44 user nova-compute[72724]:     <apic/>
Aug 17 16:26:44 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:26:44 user nova-compute[72724]:   </features>
Aug 17 16:26:44 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:26:44 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:26:44 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:26:44 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:26:44 user nova-compute[72724]:   </clock>
Aug 17 16:26:44 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:26:44 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:26:44 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:26:44 user nova-compute[72724]:   </cpu>
Aug 17 16:26:44 user nova-compute[72724]:   <devices>
Aug 17 16:26:44 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:26:44 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:26:44 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk"/>
Aug 17 16:26:44 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:26:44 user nova-compute[72724]:     </disk>
Aug 17 16:26:44 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:26:44 user nova-compute[72724]:       <mac address="fa:16:3e:f4:84:5a"/>
Aug 17 16:26:44 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:26:44 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:26:44 user nova-compute[72724]:       <target dev="tap853dcaac-14"/>
Aug 17 16:26:44 user nova-compute[72724]:     </interface>
Aug 17 16:26:44 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:26:44 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/console.log" append="off"/>
Aug 17 16:26:44 user nova-compute[72724]:     </serial>
Aug 17 16:26:44 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:26:44 user nova-compute[72724]:     <video>
Aug 17 16:26:44 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:26:44 user nova-compute[72724]:     </video>
Aug 17 16:26:44 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:26:44 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:26:44 user nova-compute[72724]:     </rng>
Aug 17 16:26:44 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:26:44 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:26:44 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:26:44 user nova-compute[72724]:     </memballoon>
Aug 17 16:26:44 user nova-compute[72724]:   </devices>
Aug 17 16:26:44 user nova-compute[72724]: </domain>
Aug 17 16:26:44 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220067116',display_name='tempest-ServerRescueNegativeTestJSON-server-220067116',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220067116',id=15,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-c10ke00q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:42Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=59a5dee3-bf14-4196-a8da-c9ea471c0752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG os_vif [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap853dcaac-14, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap853dcaac-14, col_values=(('external_ids', {'iface-id': '853dcaac-14ef-4365-9613-97c8afbbc55a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:84:5a', 'vm-uuid': '59a5dee3-bf14-4196-a8da-c9ea471c0752'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:44 user nova-compute[72724]: INFO os_vif [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14')
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:f4:84:5a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updated VIF entry in instance network info cache for port 853dcaac-14ef-4365-9613-97c8afbbc55a. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3bcfb44c-cc29-4f86-9580-4f669580397f req-7d1fb4c1-8130-4ca9-9480-163abe43bd36 service nova] Releasing lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-changed-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Refreshing instance network info cache due to event network-changed-605f0625-4ba6-4c19-8562-47d6de868f1b. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.network.neutron [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Refreshing network info cache for port 605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.network.neutron [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updated VIF entry in instance network info cache for port 605f0625-4ba6-4c19-8562-47d6de868f1b. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.network.neutron [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-236b0f0d-32c7-4a76-992d-dea77d489fb9 req-feaf2848-43a9-4215-b260-58877b86f405 service nova] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-40c9d5ad-2655-4d1c-b808-49867a6668c7 req-5804a176-1a76-4403-9114-f0e84c58596d service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-40c9d5ad-2655-4d1c-b808-49867a6668c7 req-5804a176-1a76-4403-9114-f0e84c58596d service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-40c9d5ad-2655-4d1c-b808-49867a6668c7 req-5804a176-1a76-4403-9114-f0e84c58596d service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-40c9d5ad-2655-4d1c-b808-49867a6668c7 req-5804a176-1a76-4403-9114-f0e84c58596d service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-40c9d5ad-2655-4d1c-b808-49867a6668c7 req-5804a176-1a76-4403-9114-f0e84c58596d service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:45 user nova-compute[72724]: WARNING nova.compute.manager [req-40c9d5ad-2655-4d1c-b808-49867a6668c7 req-5804a176-1a76-4403-9114-f0e84c58596d service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state building and task_state spawning.
Aug 17 16:26:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-d1b97515-83b2-40e5-9b9a-799f084af5d2 req-f635df5d-f40d-4265-8497-54dd04406ee8 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d1b97515-83b2-40e5-9b9a-799f084af5d2 req-f635df5d-f40d-4265-8497-54dd04406ee8 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d1b97515-83b2-40e5-9b9a-799f084af5d2 req-f635df5d-f40d-4265-8497-54dd04406ee8 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d1b97515-83b2-40e5-9b9a-799f084af5d2 req-f635df5d-f40d-4265-8497-54dd04406ee8 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-d1b97515-83b2-40e5-9b9a-799f084af5d2 req-f635df5d-f40d-4265-8497-54dd04406ee8 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:47 user nova-compute[72724]: WARNING nova.compute.manager [req-d1b97515-83b2-40e5-9b9a-799f084af5d2 req-f635df5d-f40d-4265-8497-54dd04406ee8 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state building and task_state spawning.
Aug 17 16:26:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-656b0140-3055-40aa-a3e3-e2a50da38700 req-e3aa3d4a-be19-40f7-a8e9-94468e39e91e service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-656b0140-3055-40aa-a3e3-e2a50da38700 req-e3aa3d4a-be19-40f7-a8e9-94468e39e91e service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-656b0140-3055-40aa-a3e3-e2a50da38700 req-e3aa3d4a-be19-40f7-a8e9-94468e39e91e service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-656b0140-3055-40aa-a3e3-e2a50da38700 req-e3aa3d4a-be19-40f7-a8e9-94468e39e91e service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-656b0140-3055-40aa-a3e3-e2a50da38700 req-e3aa3d4a-be19-40f7-a8e9-94468e39e91e service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:47 user nova-compute[72724]: WARNING nova.compute.manager [req-656b0140-3055-40aa-a3e3-e2a50da38700 req-e3aa3d4a-be19-40f7-a8e9-94468e39e91e service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state building and task_state spawning.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289609.4518437, f09067a8-3cf3-4fe7-aa75-78348da59adb => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Resumed (Lifecycle Event)
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance spawned successfully.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289609.4706059, f09067a8-3cf3-4fe7-aa75-78348da59adb => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Started (Lifecycle Event)
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance spawned successfully.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289609.5350826, 59a5dee3-bf14-4196-a8da-c9ea471c0752 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] VM Resumed (Lifecycle Event)
Aug 17 16:26:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Took 8.37 seconds to spawn the instance on the hypervisor.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289609.5353036, 59a5dee3-bf14-4196-a8da-c9ea471c0752 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] VM Started (Lifecycle Event)
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Took 9.11 seconds to build instance.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Took 7.47 seconds to spawn the instance on the hypervisor.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-41686121-aeac-44b3-aa6d-f7c90aef5d36 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.225s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:26:49 user nova-compute[72724]: INFO nova.compute.manager [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Took 8.40 seconds to build instance.
Aug 17 16:26:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fd0b9f8d-d69e-41b4-96e2-afaf1c2bec05 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.487s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-f384921b-48df-4757-ad93-b5ac85f857d7 req-6118dbbf-2bec-420c-a60d-93e82d2b3d8e service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f384921b-48df-4757-ad93-b5ac85f857d7 req-6118dbbf-2bec-420c-a60d-93e82d2b3d8e service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f384921b-48df-4757-ad93-b5ac85f857d7 req-6118dbbf-2bec-420c-a60d-93e82d2b3d8e service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f384921b-48df-4757-ad93-b5ac85f857d7 req-6118dbbf-2bec-420c-a60d-93e82d2b3d8e service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:26:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-f384921b-48df-4757-ad93-b5ac85f857d7 req-6118dbbf-2bec-420c-a60d-93e82d2b3d8e service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:26:49 user nova-compute[72724]: WARNING nova.compute.manager [req-f384921b-48df-4757-ad93-b5ac85f857d7 req-6118dbbf-2bec-420c-a60d-93e82d2b3d8e service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state active and task_state None.
Aug 17 16:26:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:26:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "621f2153-b6a5-4697-868b-39681372ff2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:13 user nova-compute[72724]: INFO nova.compute.manager [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Terminating instance
Aug 17 16:27:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-c7295a1b-c74e-4608-a2ff-913b3993900a req-ae9f993d-6b91-478f-999c-db63bc8ae5dc service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-vif-unplugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c7295a1b-c74e-4608-a2ff-913b3993900a req-ae9f993d-6b91-478f-999c-db63bc8ae5dc service nova] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c7295a1b-c74e-4608-a2ff-913b3993900a req-ae9f993d-6b91-478f-999c-db63bc8ae5dc service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c7295a1b-c74e-4608-a2ff-913b3993900a req-ae9f993d-6b91-478f-999c-db63bc8ae5dc service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-c7295a1b-c74e-4608-a2ff-913b3993900a req-ae9f993d-6b91-478f-999c-db63bc8ae5dc service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] No waiting events found dispatching network-vif-unplugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-c7295a1b-c74e-4608-a2ff-913b3993900a req-ae9f993d-6b91-478f-999c-db63bc8ae5dc service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-vif-unplugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:27:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Instance destroyed successfully.
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'resources' on Instance uuid 621f2153-b6a5-4697-868b-39681372ff2f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:25:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1083593039',display_name='tempest-VolumesAdminNegativeTest-server-1083593039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1083593039',id=11,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:25:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe523fb48904a97a8b02bbe415b6794',ramdisk_id='',reservation_id='r-jxqno82g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1491017065',owner_user_name='tempest-VolumesAdminNegativeTest-1491017065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:25:18Z,user_data=None,user_id='6c77204386d84a2181e58358f1ade5a2',uuid=621f2153-b6a5-4697-868b-39681372ff2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converting VIF {"id": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "address": "fa:16:3e:81:b4:4a", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped0ef657-76", "ovs_interfaceid": "ed0ef657-76ee-46d3-ba59-e211ffc43690", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG os_vif [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped0ef657-76, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:27:14 user nova-compute[72724]: INFO os_vif [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:b4:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed0ef657-76ee-46d3-ba59-e211ffc43690,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped0ef657-76')
Aug 17 16:27:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Deleting instance files /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f_del
Aug 17 16:27:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Deletion of /opt/stack/data/nova/instances/621f2153-b6a5-4697-868b-39681372ff2f_del complete
Aug 17 16:27:14 user nova-compute[72724]: INFO nova.compute.manager [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Took 0.75 seconds to destroy the instance on the hypervisor.
Aug 17 16:27:14 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:14 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Took 0.56 seconds to deallocate network for instance.
Aug 17 16:27:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-4ca07f47-501d-4a1e-b380-54402b0cf1b6 req-a0edde66-7057-4539-b64e-23ffb83e5ada service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-vif-deleted-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:15 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:27:15 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:27:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:15 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Deleted allocations for instance 621f2153-b6a5-4697-868b-39681372ff2f
Aug 17 16:27:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e78cfd5e-103c-4b6a-a615-a634c0721661 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "621f2153-b6a5-4697-868b-39681372ff2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-1281e834-5386-4333-9c4d-cabe853ab35f req-561d3b98-339b-40c9-9eda-950bb313295a service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received event network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1281e834-5386-4333-9c4d-cabe853ab35f req-561d3b98-339b-40c9-9eda-950bb313295a service nova] Acquiring lock "621f2153-b6a5-4697-868b-39681372ff2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1281e834-5386-4333-9c4d-cabe853ab35f req-561d3b98-339b-40c9-9eda-950bb313295a service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1281e834-5386-4333-9c4d-cabe853ab35f req-561d3b98-339b-40c9-9eda-950bb313295a service nova] Lock "621f2153-b6a5-4697-868b-39681372ff2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-1281e834-5386-4333-9c4d-cabe853ab35f req-561d3b98-339b-40c9-9eda-950bb313295a service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] No waiting events found dispatching network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:16 user nova-compute[72724]: WARNING nova.compute.manager [req-1281e834-5386-4333-9c4d-cabe853ab35f req-561d3b98-339b-40c9-9eda-950bb313295a service nova] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Received unexpected event network-vif-plugged-ed0ef657-76ee-46d3-ba59-e211ffc43690 for instance with vm_state deleted and task_state None.
Aug 17 16:27:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:27:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:26 user nova-compute[72724]: INFO nova.compute.manager [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Detaching volume 39ac30ff-b1c2-4dfb-8d57-070e8558fb2a
Aug 17 16:27:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:26 user nova-compute[72724]: INFO nova.virt.block_device [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Attempting to driver detach volume 39ac30ff-b1c2-4dfb-8d57-070e8558fb2a from mountpoint /dev/vdc
Aug 17 16:27:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Attempting to detach device vdc from instance 254406ea-145e-40ff-8252-9e4a28db4892 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:27:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:27:26 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:27:26 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:27:26 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 16:27:26 user nova-compute[72724]:   <serial>39ac30ff-b1c2-4dfb-8d57-070e8558fb2a</serial>
Aug 17 16:27:26 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 16:27:26 user nova-compute[72724]: </disk>
Aug 17 16:27:26 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:27:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully detached device vdc from instance 254406ea-145e-40ff-8252-9e4a28db4892 from the persistent domain config.
Aug 17 16:27:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 254406ea-145e-40ff-8252-9e4a28db4892 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:27:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:27:26 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:27:26 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:27:26 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 16:27:26 user nova-compute[72724]:   <serial>39ac30ff-b1c2-4dfb-8d57-070e8558fb2a</serial>
Aug 17 16:27:26 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 16:27:26 user nova-compute[72724]: </disk>
Aug 17 16:27:26 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289647.1571279, 254406ea-145e-40ff-8252-9e4a28db4892 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:27:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully detached device vdc from instance 254406ea-145e-40ff-8252-9e4a28db4892 from the live domain config.
Aug 17 16:27:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ihwseHcU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:27:27 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ef975a-1388-4af1-bd7b-415ba688602d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c832aa-f509-48d8-8f87-82bdac1a5e11]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:27:27 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:27:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:27:27 user nova-compute[72724]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a (non-flash)
Aug 17 16:27:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81191b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c06985-0a58-40ef-88e6-9ea1bde385fd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac36d54-0b59-4d9a-8220-b12b343721df]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[147ade80-dbe2-4415-8a0d-3bd55d8f9bea]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82dfe15b-3c58-4e91-90b0-a7c77627f889]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6068410a-64a1-4653-a4db-28d4489c280b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ee92bd-5079-442b-a207-1039121eb8bf]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260]
Aug 17 16:27:27 user nova-compute[72724]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a, portal: 172.16.0.220,3260] successful.
Aug 17 16:27:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39ac30ff-b1c2-4dfb-8d57-070e8558fb2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5fd630-26c2-4b87-aa48-7312dfda48fe]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] <== disconnect_volume: return (288ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:27:27 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:27:28 user nova-compute[72724]: INFO nova.compute.manager [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Unrescuing
Aug 17 16:27:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'flavor' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-810850a0-903f-418e-9684-86e950680dd6 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.606s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'flavor' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289634.1433816, 621f2153-b6a5-4697-868b-39681372ff2f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:27:29 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] VM Stopped (Lifecycle Event)
Aug 17 16:27:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-aa72b157-305c-4e32-a2d8-2dfe152a38d4 None None] [instance: 621f2153-b6a5-4697-868b-39681372ff2f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-478ef5e8-1a53-4121-af0d-97e1536b04be req-9c86b894-e40b-4a72-b7c0-b47f7ef829a2 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-478ef5e8-1a53-4121-af0d-97e1536b04be req-9c86b894-e40b-4a72-b7c0-b47f7ef829a2 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-478ef5e8-1a53-4121-af0d-97e1536b04be req-9c86b894-e40b-4a72-b7c0-b47f7ef829a2 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-478ef5e8-1a53-4121-af0d-97e1536b04be req-9c86b894-e40b-4a72-b7c0-b47f7ef829a2 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-478ef5e8-1a53-4121-af0d-97e1536b04be req-9c86b894-e40b-4a72-b7c0-b47f7ef829a2 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:29 user nova-compute[72724]: WARNING nova.compute.manager [req-478ef5e8-1a53-4121-af0d-97e1536b04be req-9c86b894-e40b-4a72-b7c0-b47f7ef829a2 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:27:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance destroyed successfully.
Aug 17 16:27:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing instance network info cache due to event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG nova.network.neutron [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-c265cbf3-ac17-49de-9482-b9a3801b7dad req-1e001008-b898-4ec1-bba3-b96f805f527a service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c265cbf3-ac17-49de-9482-b9a3801b7dad req-1e001008-b898-4ec1-bba3-b96f805f527a service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c265cbf3-ac17-49de-9482-b9a3801b7dad req-1e001008-b898-4ec1-bba3-b96f805f527a service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c265cbf3-ac17-49de-9482-b9a3801b7dad req-1e001008-b898-4ec1-bba3-b96f805f527a service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-c265cbf3-ac17-49de-9482-b9a3801b7dad req-1e001008-b898-4ec1-bba3-b96f805f527a service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:31 user nova-compute[72724]: WARNING nova.compute.manager [req-c265cbf3-ac17-49de-9482-b9a3801b7dad req-1e001008-b898-4ec1-bba3-b96f805f527a service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:27:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updated VIF entry in instance network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c6aeb3b3-db9b-4b8e-bde3-4d7c6333e67a req-a32cf3ed-7d4b-47f9-aab6-310a0756ab68 service nova] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing instance network info cache due to event network-changed-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG nova.network.neutron [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Refreshing network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:27:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.network.neutron [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updated VIF entry in instance network info cache for port 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.network.neutron [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b8f96b0a-b938-4c6f-90ba-8c82489a9879 req-b9769426-157a-4c3d-88de-46f77bcdeca0 service nova] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for bab1abaa-414c-4c50-ae78-be9126d9aafc due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289653.287756, bab1abaa-414c-4c50-ae78-be9126d9aafc => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:27:33 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Resumed (Lifecycle Event)
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4cabe3a2-0058-4f77-bed4-2e8e7c81507b tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:27:33 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289653.2892575, bab1abaa-414c-4c50-ae78-be9126d9aafc => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:27:33 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Started (Lifecycle Event)
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:33 user nova-compute[72724]: WARNING nova.compute.manager [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state None.
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:33 user nova-compute[72724]: WARNING nova.compute.manager [req-b63d6b3f-d105-4a35-9726-9de0fc61b06b req-7588aa41-dfc9-427b-94df-2858763286fd service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state active and task_state None.
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [{"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-bab1abaa-414c-4c50-ae78-be9126d9aafc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:27:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:27:35 user nova-compute[72724]: INFO nova.compute.claims [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Claim successful on node user
Aug 17 16:27:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.650s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:27:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.policy [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c4b6bc314a140e0a5f12ecfbb43450f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2796590bb0c43479a3e82c1c4c836b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.330s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:27:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Creating image(s)
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "/opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk 1073741824" returned: 0 in 0.098s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Successfully created port: 989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Cannot resize image /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:27:37 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'migration_context' on Instance uuid 333d38b1-26ec-4bd1-82d3-da202f339acb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Ensure instance console log exists: /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:38 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:27:38 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7679MB free_disk=25.62183380126953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 75fd7469-8155-43cf-a93c-fac4132c8f03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 254406ea-145e-40ff-8252-9e4a28db4892 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6d53a869-a011-47cc-ae06-9f499036bcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Successfully updated port: 989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-changed-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Refreshing instance network info cache due to event network-changed-989c4b5f-3118-449f-b950-a06df2ef7b3d. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] Acquiring lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:27:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.575s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Instance network_info: |[{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] Acquired lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.neutron [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Refreshing network info cache for port 989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Start _get_guest_xml network_info=[{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:27:39 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:27:39 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904099515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904099515',id=16,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-aa2v9rmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:27:36Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=333d38b1-26ec-4bd1-82d3-da202f339acb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'pci_devices' on Instance uuid 333d38b1-26ec-4bd1-82d3-da202f339acb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:27:39 user nova-compute[72724]:   <uuid>333d38b1-26ec-4bd1-82d3-da202f339acb</uuid>
Aug 17 16:27:39 user nova-compute[72724]:   <name>instance-00000010</name>
Aug 17 16:27:39 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:27:39 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:27:39 user nova-compute[72724]:   <metadata>
Aug 17 16:27:39 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:27:39 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:27:39 user nova-compute[72724]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1904099515</nova:name>
Aug 17 16:27:39 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:27:39</nova:creationTime>
Aug 17 16:27:39 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:27:39 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:27:39 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:27:39 user nova-compute[72724]:       <nova:owner>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:user uuid="9c4b6bc314a140e0a5f12ecfbb43450f">tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member</nova:user>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:project uuid="d2796590bb0c43479a3e82c1c4c836b0">tempest-ServerBootFromVolumeStableRescueTest-1911010508</nova:project>
Aug 17 16:27:39 user nova-compute[72724]:       </nova:owner>
Aug 17 16:27:39 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:27:39 user nova-compute[72724]:       <nova:ports>
Aug 17 16:27:39 user nova-compute[72724]:         <nova:port uuid="989c4b5f-3118-449f-b950-a06df2ef7b3d">
Aug 17 16:27:39 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:27:39 user nova-compute[72724]:         </nova:port>
Aug 17 16:27:39 user nova-compute[72724]:       </nova:ports>
Aug 17 16:27:39 user nova-compute[72724]:     </nova:instance>
Aug 17 16:27:39 user nova-compute[72724]:   </metadata>
Aug 17 16:27:39 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:27:39 user nova-compute[72724]:     <system>
Aug 17 16:27:39 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:27:39 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:27:39 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:27:39 user nova-compute[72724]:       <entry name="serial">333d38b1-26ec-4bd1-82d3-da202f339acb</entry>
Aug 17 16:27:39 user nova-compute[72724]:       <entry name="uuid">333d38b1-26ec-4bd1-82d3-da202f339acb</entry>
Aug 17 16:27:39 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:27:39 user nova-compute[72724]:     </system>
Aug 17 16:27:39 user nova-compute[72724]:   </sysinfo>
Aug 17 16:27:39 user nova-compute[72724]:   <os>
Aug 17 16:27:39 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:27:39 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:27:39 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:27:39 user nova-compute[72724]:   </os>
Aug 17 16:27:39 user nova-compute[72724]:   <features>
Aug 17 16:27:39 user nova-compute[72724]:     <acpi/>
Aug 17 16:27:39 user nova-compute[72724]:     <apic/>
Aug 17 16:27:39 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:27:39 user nova-compute[72724]:   </features>
Aug 17 16:27:39 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:27:39 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:27:39 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:27:39 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:27:39 user nova-compute[72724]:   </clock>
Aug 17 16:27:39 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:27:39 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:27:39 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:27:39 user nova-compute[72724]:   </cpu>
Aug 17 16:27:39 user nova-compute[72724]:   <devices>
Aug 17 16:27:39 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:27:39 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:27:39 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk"/>
Aug 17 16:27:39 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:27:39 user nova-compute[72724]:     </disk>
Aug 17 16:27:39 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:27:39 user nova-compute[72724]:       <mac address="fa:16:3e:e4:0c:0c"/>
Aug 17 16:27:39 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:27:39 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:27:39 user nova-compute[72724]:       <target dev="tap989c4b5f-31"/>
Aug 17 16:27:39 user nova-compute[72724]:     </interface>
Aug 17 16:27:39 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:27:39 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/console.log" append="off"/>
Aug 17 16:27:39 user nova-compute[72724]:     </serial>
Aug 17 16:27:39 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:27:39 user nova-compute[72724]:     <video>
Aug 17 16:27:39 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:27:39 user nova-compute[72724]:     </video>
Aug 17 16:27:39 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:27:39 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:27:39 user nova-compute[72724]:     </rng>
Aug 17 16:27:39 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:27:39 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:27:39 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:27:39 user nova-compute[72724]:     </memballoon>
Aug 17 16:27:39 user nova-compute[72724]:   </devices>
Aug 17 16:27:39 user nova-compute[72724]: </domain>
Aug 17 16:27:39 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904099515',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904099515',id=16,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-aa2v9rmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:27:36Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=333d38b1-26ec-4bd1-82d3-da202f339acb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG os_vif [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap989c4b5f-31, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap989c4b5f-31, col_values=(('external_ids', {'iface-id': '989c4b5f-3118-449f-b950-a06df2ef7b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:0c:0c', 'vm-uuid': '333d38b1-26ec-4bd1-82d3-da202f339acb'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:39 user nova-compute[72724]: INFO os_vif [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31')
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No VIF found with MAC fa:16:3e:e4:0c:0c, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.neutron [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updated VIF entry in instance network info cache for port 989c4b5f-3118-449f-b950-a06df2ef7b3d. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG nova.network.neutron [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8f7c3eff-7f29-4613-a24a-33ba64f7ae4b req-16dc9220-f4f3-42d9-afe9-ada0ef7691d6 service nova] Releasing lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-bedfd934-cf81-496c-bf96-b2893c7fb6dc req-cf82dfa7-7f7c-4665-8934-3df4a40ce7cb service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bedfd934-cf81-496c-bf96-b2893c7fb6dc req-cf82dfa7-7f7c-4665-8934-3df4a40ce7cb service nova] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bedfd934-cf81-496c-bf96-b2893c7fb6dc req-cf82dfa7-7f7c-4665-8934-3df4a40ce7cb service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bedfd934-cf81-496c-bf96-b2893c7fb6dc req-cf82dfa7-7f7c-4665-8934-3df4a40ce7cb service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-bedfd934-cf81-496c-bf96-b2893c7fb6dc req-cf82dfa7-7f7c-4665-8934-3df4a40ce7cb service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] No waiting events found dispatching network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:40 user nova-compute[72724]: WARNING nova.compute.manager [req-bedfd934-cf81-496c-bf96-b2893c7fb6dc req-cf82dfa7-7f7c-4665-8934-3df4a40ce7cb service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received unexpected event network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d for instance with vm_state building and task_state spawning.
Aug 17 16:27:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289662.772142, 333d38b1-26ec-4bd1-82d3-da202f339acb => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] VM Resumed (Lifecycle Event)
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Instance spawned successfully.
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289662.7730837, 333d38b1-26ec-4bd1-82d3-da202f339acb => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] VM Started (Lifecycle Event)
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Took 6.15 seconds to spawn the instance on the hypervisor.
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7af5f53-ed2e-45ae-ab37-256eaebbba8a req-a15cf456-6ade-41fa-a241-77192b3a27d2 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7af5f53-ed2e-45ae-ab37-256eaebbba8a req-a15cf456-6ade-41fa-a241-77192b3a27d2 service nova] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7af5f53-ed2e-45ae-ab37-256eaebbba8a req-a15cf456-6ade-41fa-a241-77192b3a27d2 service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7af5f53-ed2e-45ae-ab37-256eaebbba8a req-a15cf456-6ade-41fa-a241-77192b3a27d2 service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7af5f53-ed2e-45ae-ab37-256eaebbba8a req-a15cf456-6ade-41fa-a241-77192b3a27d2 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] No waiting events found dispatching network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:27:42 user nova-compute[72724]: WARNING nova.compute.manager [req-d7af5f53-ed2e-45ae-ab37-256eaebbba8a req-a15cf456-6ade-41fa-a241-77192b3a27d2 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received unexpected event network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d for instance with vm_state building and task_state spawning.
Aug 17 16:27:42 user nova-compute[72724]: INFO nova.compute.manager [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Took 7.60 seconds to build instance.
Aug 17 16:27:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b74ac4ca-e090-4304-84c4-81fd0acbe3cc tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.772s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-changed-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Refreshing instance network info cache due to event network-changed-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] Acquiring lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] Acquired lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Refreshing network info cache for port 9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lazy-loading 'flavor' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:27:46 user nova-compute[72724]: INFO nova.compute.manager [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Attaching volume a944bb9f-65d9-423b-bf76-66f02bbeba14 to /dev/vdb
Aug 17 16:27:46 user nova-compute[72724]: DEBUG os_brick.utils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ae2176-f7b8-4fca-a166-b10d869e1d4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updated VIF entry in instance network info cache for port 9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updating instance_info_cache with network_info: [{"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8f2a3e-9d3e-4a0d-af1b-ace477d96561]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[859f9702-1e6b-4599-ae5f-4b9c8657b845]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[46702bf2-fb13-4242-b7c8-d0480edfa533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:27:46 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd1cf05-9591-4ac3-bf60-2ec20a7d7168]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG os_brick.utils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updating existing volume attachment record: 8df5874a-f446-4589-a4e9-c9e8c7f5a3e5 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:27:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cc79245b-623a-457b-ad8e-f87fe8c841aa req-e628d88d-0dc9-4701-9b5d-76582ecb375c service nova] Releasing lock "refresh_cache-6d53a869-a011-47cc-ae06-9f499036bcc7" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:27:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:27:58 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:27:58 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:27:58 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c0387e-56bb-41db-b76b-39a66b1cdd1e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:27:58 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2f3d32-5618-4fb7-9300-33e448a2d2a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14] added
Aug 17 16:27:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bbc4a7-9d50-46a1-924c-bce49c3a4a96]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55a359e-3069-49ee-8194-2bb3001d38de]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERHWbsqw {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERHWbsqw" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[39aea75b-a76e-48b8-bd74-6d16417a8186]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERHWbsqw'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ea635a-ab64-4bd8-b62e-ff68647670cb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc04a40d-5abe-4642-aec7-ed4bc95a7aa3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:27:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:27:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27da154-8fd1-4060-a8a8-a18c2d9ecb06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]
Aug 17 16:27:58 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.
Aug 17 16:27:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff94a4c-de33-454a-8348-396556050723]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[68857064-f639-4ab3-aa1a-faa4aa929e66]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:27:58 user nova-compute[72724]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:27:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:27:58 user nova-compute[72724]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:27:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f350a-f7d9-40a0-82e0-4e2b1b3c36fe]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:27:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:27:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:27:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:27:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23036383735393837', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:27:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036383735393837', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:27:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lazy-loading 'flavor' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:27:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:27:59 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:27:59 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:27:59 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:27:59 user nova-compute[72724]:   <serial>a944bb9f-65d9-423b-bf76-66f02bbeba14</serial>
Aug 17 16:27:59 user nova-compute[72724]: </disk>
Aug 17 16:27:59 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:28:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:28:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:28:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] No VIF found with MAC fa:16:3e:c7:65:9f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:28:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0e8d808e-93a5-4398-8f94-1391d0a8131a tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.516s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG os_brick.utils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65f6e55-e50f-4c3b-9ada-d40685d3abd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a457c4e9-4379-43c3-8e1b-114f148f3d6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[79835d44-6067-46eb-88d5-b3cafc1db648]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af861ee0-c5a7-4894-8f12-d2d12029dfb3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:28:01 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:28:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b68f89-eae0-486c-8dbe-d95e68a7ab0e]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:28:01 user nova-compute[72724]: DEBUG os_brick.utils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:01 user nova-compute[72724]: INFO nova.compute.manager [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Swapping volume a944bb9f-65d9-423b-bf76-66f02bbeba14 for 3e3e7d91-378d-4d52-bbab-97c2f48f7db9
Aug 17 16:28:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:02 user nova-compute[72724]: INFO nova.compute.manager [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Detaching volume bf3bafc2-04f4-4e92-9463-5bde493a6f51
Aug 17 16:28:02 user nova-compute[72724]: INFO nova.virt.block_device [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Attempting to driver detach volume bf3bafc2-04f4-4e92-9463-5bde493a6f51 from mountpoint /dev/vdb
Aug 17 16:28:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Attempting to detach device vdb from instance bab1abaa-414c-4c50-ae78-be9126d9aafc from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:28:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:28:02 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:28:02 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:28:02 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:28:02 user nova-compute[72724]:   <serial>bf3bafc2-04f4-4e92-9463-5bde493a6f51</serial>
Aug 17 16:28:02 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:28:02 user nova-compute[72724]: </disk>
Aug 17 16:28:02 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:28:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Successfully detached device vdb from instance bab1abaa-414c-4c50-ae78-be9126d9aafc from the persistent domain config.
Aug 17 16:28:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bab1abaa-414c-4c50-ae78-be9126d9aafc from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:28:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:28:02 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:28:02 user nova-compute[72724]:   <source dev="/dev/sdh"/>
Aug 17 16:28:02 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:28:02 user nova-compute[72724]:   <serial>bf3bafc2-04f4-4e92-9463-5bde493a6f51</serial>
Aug 17 16:28:02 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:28:02 user nova-compute[72724]: </disk>
Aug 17 16:28:02 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289683.1697924, bab1abaa-414c-4c50-ae78-be9126d9aafc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:28:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Successfully detached device vdb from instance bab1abaa-414c-4c50-ae78-be9126d9aafc from the live domain config.
Aug 17 16:28:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogFDytmL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[86892112-4e6a-4675-bad0-b7c174b99746]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcd86263-64c1-4efa-8365-ed3566a99b26]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:28:03 user nova-compute[72724]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 (non-flash)
Aug 17 16:28:03 user nova-compute[72724]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86929e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51'): ({'sdh'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Removing single pathed devices sdh {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9859efad-8224-4a7e-bcf7-b013ac2d90f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bab2ade-5f0d-4bba-b6ed-5ba82d1046ee]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Flushing IO for device /dev/sdh {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f0fc09-7d1c-49ac-ba67-40bff9cbca97]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.044s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[844b989f-a69f-4e0c-b1f6-eaec5585d970]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] SCSI volumes sdh have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac59099-4eca-4906-b056-adb33ac41b6c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bc7d5f-62d5-40e7-a1d5-eb92f0ab26a2]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260]
Aug 17 16:28:03 user nova-compute[72724]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51, portal: 172.16.0.220,3260] successful.
Aug 17 16:28:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf3bafc2-04f4-4e92-9463-5bde493a6f51 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[346de1ba-1da3-40ca-a293-c7c4a9bcd112]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] <== disconnect_volume: return (283ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:28:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:04 user nova-compute[72724]: DEBUG nova.objects.instance [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'flavor' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a34ec91c-743f-4593-89fd-2b924683b970 tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.837s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:10 user nova-compute[72724]: INFO nova.compute.manager [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Terminating instance
Aug 17 16:28:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-1c0853a9-1123-4dd8-838b-3f96aecd925a req-841ea794-e03f-47aa-91e4-8e1fee63fbaf service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-vif-unplugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1c0853a9-1123-4dd8-838b-3f96aecd925a req-841ea794-e03f-47aa-91e4-8e1fee63fbaf service nova] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1c0853a9-1123-4dd8-838b-3f96aecd925a req-841ea794-e03f-47aa-91e4-8e1fee63fbaf service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1c0853a9-1123-4dd8-838b-3f96aecd925a req-841ea794-e03f-47aa-91e4-8e1fee63fbaf service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-1c0853a9-1123-4dd8-838b-3f96aecd925a req-841ea794-e03f-47aa-91e4-8e1fee63fbaf service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] No waiting events found dispatching network-vif-unplugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-1c0853a9-1123-4dd8-838b-3f96aecd925a req-841ea794-e03f-47aa-91e4-8e1fee63fbaf service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-vif-unplugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Instance destroyed successfully.
Aug 17 16:28:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lazy-loading 'resources' on Instance uuid 75fd7469-8155-43cf-a93c-fac4132c8f03 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:22:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1506414030',display_name='tempest-VolumesAdminNegativeTest-server-1506414030',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1506414030',id=6,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWeJY7ZsxSl6lh9TmMXNmgSW/l0e40QPwRwt2LT1uysF0L5+gU5srAejl0MT7GDukBxRKOQ3BsDRYVQ+tME8e7IFUA8eKefsezDWpIxospYHITGsbl57kQuQmaHkjG1Dw==',key_name='tempest-keypair-1500127610',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:22:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dbe523fb48904a97a8b02bbe415b6794',ramdisk_id='',reservation_id='r-fc0x1o3g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1491017065',owner_user_name='tempest-VolumesAdminNegativeTest-1491017065-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:22:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c77204386d84a2181e58358f1ade5a2',uuid=75fd7469-8155-43cf-a93c-fac4132c8f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converting VIF {"id": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "address": "fa:16:3e:cc:9e:06", "network": {"id": "f57779e2-c84c-467a-b680-011dd6d0ce4c", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1186107741-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dbe523fb48904a97a8b02bbe415b6794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8d94a49-1d", "ovs_interfaceid": "a8d94a49-1d51-4196-93c2-d171ae349cd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG os_vif [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8d94a49-1d, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:11 user nova-compute[72724]: INFO os_vif [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:9e:06,bridge_name='br-int',has_traffic_filtering=True,id=a8d94a49-1d51-4196-93c2-d171ae349cd5,network=Network(f57779e2-c84c-467a-b680-011dd6d0ce4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8d94a49-1d')
Aug 17 16:28:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Deleting instance files /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03_del
Aug 17 16:28:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Deletion of /opt/stack/data/nova/instances/75fd7469-8155-43cf-a93c-fac4132c8f03_del complete
Aug 17 16:28:11 user nova-compute[72724]: INFO nova.compute.manager [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 17 16:28:11 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:28:11 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:12 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Took 0.92 seconds to deallocate network for instance.
Aug 17 16:28:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-2c815684-597d-4b91-935e-a495bb6aad52 req-8a1d7f7c-2afe-4774-a659-5b6110822487 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-vif-deleted-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkxEMZAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d53a869-a011-47cc-ae06-9f499036bcc7', 'attached_at': '', 'detached_at': '', 'volume_id': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9', 'serial': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6d53a869-a011-47cc-ae06-9f499036bcc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a944bb9f-65d9-423b-bf76-66f02bbeba14', 'serial'} {{(pid=72724) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkxEMZAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:12 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d5e72d-9a1c-44b5-8ccb-77e6a653a797]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:28:12 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[586fe607-1bb0-4578-99c4-f9c4ec17a2fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9] added
Aug 17 16:28:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508bf5c-20f3-4c96-bb5a-4ac36f2d9564]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0babf74a-de3b-4c61-8bf1-18aa44e938ae]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkxEMZAF {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WkxEMZAF" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d0d224-f010-4d4a-8903-1f802db5ae74]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WkxEMZAF'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[089cbe2c-1c92-4503-abb0-fb1b8728d46d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31d0334-8942-4205-afdd-e58797283a01]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32f165-d22f-4722-9193-0ede0a47e71b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260]
Aug 17 16:28:12 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260] successful.
Aug 17 16:28:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a7aed4-848a-4fbc-915d-9c597e512450]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd9026d-ef0f-4d63-9ba3-d677632603fe]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:12 user nova-compute[72724]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:12 user nova-compute[72724]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3fb1c0-fffe-40de-95c7-a756947a38a1]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:28:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkxEMZAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:28:12 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Deleted allocations for instance 75fd7469-8155-43cf-a93c-fac4132c8f03
Aug 17 16:28:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c9ee9a9-cbff-4e48-aa88-a98266932316 tempest-VolumesAdminNegativeTest-1491017065 tempest-VolumesAdminNegativeTest-1491017065-project-member] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-b85d8482-cbd1-401b-ab70-90cd1e12774c req-7e2e1f44-cc89-4e25-b079-039df07d1511 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received event network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b85d8482-cbd1-401b-ab70-90cd1e12774c req-7e2e1f44-cc89-4e25-b079-039df07d1511 service nova] Acquiring lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b85d8482-cbd1-401b-ab70-90cd1e12774c req-7e2e1f44-cc89-4e25-b079-039df07d1511 service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b85d8482-cbd1-401b-ab70-90cd1e12774c req-7e2e1f44-cc89-4e25-b079-039df07d1511 service nova] Lock "75fd7469-8155-43cf-a93c-fac4132c8f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-b85d8482-cbd1-401b-ab70-90cd1e12774c req-7e2e1f44-cc89-4e25-b079-039df07d1511 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] No waiting events found dispatching network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:13 user nova-compute[72724]: WARNING nova.compute.manager [req-b85d8482-cbd1-401b-ab70-90cd1e12774c req-7e2e1f44-cc89-4e25-b079-039df07d1511 service nova] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Received unexpected event network-vif-plugged-a8d94a49-1d51-4196-93c2-d171ae349cd5 for instance with vm_state deleted and task_state None.
Aug 17 16:28:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '23033623663623066', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033623663623066', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:28:13 user nova-compute[72724]: DEBUG nova.objects.instance [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lazy-loading 'flavor' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 149946368 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 342884352 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 532676608 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:28:16 user nova-compute[72724]: INFO nova.compute.claims [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Claim successful on node user
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 708837376 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:28:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 893386752 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.policy [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df91a9dc8e5b49f3bf2188ab3a96b1e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5fa57b31426d46ad8fa5351fe3ebb91e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:28:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Creating image(s)
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "/opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "/opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "/opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.279s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:17 user nova-compute[72724]: INFO nova.compute.manager [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Terminating instance
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 1063256064 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.221s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk 1073741824" returned: 0 in 0.059s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-a867229f-acb3-41e3-acb2-8cdc95d82375 req-d36927a5-2eea-4f04-bb1c-a2bfe7d6038c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a867229f-acb3-41e3-acb2-8cdc95d82375 req-d36927a5-2eea-4f04-bb1c-a2bfe7d6038c service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a867229f-acb3-41e3-acb2-8cdc95d82375 req-d36927a5-2eea-4f04-bb1c-a2bfe7d6038c service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a867229f-acb3-41e3-acb2-8cdc95d82375 req-d36927a5-2eea-4f04-bb1c-a2bfe7d6038c service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-a867229f-acb3-41e3-acb2-8cdc95d82375 req-d36927a5-2eea-4f04-bb1c-a2bfe7d6038c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-a867229f-acb3-41e3-acb2-8cdc95d82375 req-d36927a5-2eea-4f04-bb1c-a2bfe7d6038c service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Checking if we can resize image /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Successfully created port: 08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Cannot resize image /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lazy-loading 'migration_context' on Instance uuid 35b4fcf8-40f6-48b4-a785-c14a86027233 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Ensure instance console log exists: /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Instance destroyed successfully.
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'resources' on Instance uuid 254406ea-145e-40ff-8252-9e4a28db4892 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:21:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-598960467',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-598960467',id=3,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE1S2U12q5XINVADtNiCYU+kxRLjdYC41oNeqB6/Ik3Y5bQlkgACwecUp9tCsemyfBWU7IEYLJGNQHWuk3ln03j/NicNbuIe/pUxMeSCvCGQEZBLy8KOEURrspLreUwl9Q==',key_name='tempest-keypair-513051232',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:26:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-o12a1ie6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:26:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=254406ea-145e-40ff-8252-9e4a28db4892,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "address": "fa:16:3e:9b:3b:75", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf4682ae-3a", "ovs_interfaceid": "af4682ae-3a41-498e-a6b5-90e3492b5e80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_vif [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf4682ae-3a, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:18 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:28:18 user nova-compute[72724]: INFO os_vif [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:3b:75,bridge_name='br-int',has_traffic_filtering=True,id=af4682ae-3a41-498e-a6b5-90e3492b5e80,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf4682ae-3a')
Aug 17 16:28:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Deleting instance files /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892_del
Aug 17 16:28:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Deletion of /opt/stack/data/nova/instances/254406ea-145e-40ff-8252-9e4a28db4892_del complete
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2052666-9576-4bb8-aebd-6c998c77f497]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a1a24-5cbf-49a6-84df-3f1f566dab1e]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:18 user nova-compute[72724]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:18 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:18 user nova-compute[72724]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:18 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86ed120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6105bf-1c9f-4359-a344-7dfb7bbab453]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[975217d7-b2b1-408e-b507-65bc204adecd]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:28:18 user nova-compute[72724]: INFO nova.compute.manager [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Took 1.01 seconds to destroy the instance on the hypervisor.
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[145369a3-1d60-4003-b087-4d7dcdc55478]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf8a9a7-327c-47a3-9771-f5c97d2b643e]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8db8372-8029-4d5a-a404-f7b531d2c409]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[801b01f1-d9e0-4820-9f7d-a5bd42946823]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]
Aug 17 16:28:18 user nova-compute[72724]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.
Aug 17 16:28:18 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e79d12-5d85-49e9-acea-464323dbec9c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] <== disconnect_volume: return (318ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkxEMZAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '6d53a869-a011-47cc-ae06-9f499036bcc7', 'attached_at': '', 'detached_at': '', 'volume_id': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9', 'serial'} {{(pid=72724) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] swap_volume: removing Cinder connection for volume a944bb9f-65d9-423b-bf76-66f02bbeba14 {{(pid=72724) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Successfully updated port: 08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "refresh_cache-35b4fcf8-40f6-48b4-a785-c14a86027233" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquired lock "refresh_cache-35b4fcf8-40f6-48b4-a785-c14a86027233" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-changed-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Refreshing instance network info cache due to event network-changed-08933904-896d-4a51-9df9-e7e9d168cd65. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] Acquiring lock "refresh_cache-35b4fcf8-40f6-48b4-a785-c14a86027233" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Updating instance_info_cache with network_info: [{"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Releasing lock "refresh_cache-35b4fcf8-40f6-48b4-a785-c14a86027233" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Instance network_info: |[{"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] Acquired lock "refresh_cache-35b4fcf8-40f6-48b4-a785-c14a86027233" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Refreshing network info cache for port 08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Start _get_guest_xml network_info=[{"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-997294747',display_name='tempest-ServersNegativeTestJSON-server-997294747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-997294747',id=17,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa57b31426d46ad8fa5351fe3ebb91e',ramdisk_id='',reservation_id='r-026hj5s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-566124124',owner_user_name='tempest-ServersNegativeTestJSON-566124124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:28:17Z,user_data=None,user_id='df91a9dc8e5b49f3bf2188ab3a96b1e8',uuid=35b4fcf8-40f6-48b4-a785-c14a86027233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converting VIF {"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lazy-loading 'pci_devices' on Instance uuid 35b4fcf8-40f6-48b4-a785-c14a86027233 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-46a8f1b6-2b87-4744-8102-894dd6441336 req-3d9443da-7dfc-4c8a-b377-a5969183e897 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-deleted-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:19 user nova-compute[72724]: INFO nova.compute.manager [req-46a8f1b6-2b87-4744-8102-894dd6441336 req-3d9443da-7dfc-4c8a-b377-a5969183e897 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Neutron deleted interface af4682ae-3a41-498e-a6b5-90e3492b5e80; detaching it from the instance and deleting it from the info cache
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-46a8f1b6-2b87-4744-8102-894dd6441336 req-3d9443da-7dfc-4c8a-b377-a5969183e897 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:28:19 user nova-compute[72724]:   <uuid>35b4fcf8-40f6-48b4-a785-c14a86027233</uuid>
Aug 17 16:28:19 user nova-compute[72724]:   <name>instance-00000011</name>
Aug 17 16:28:19 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:28:19 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:28:19 user nova-compute[72724]:   <metadata>
Aug 17 16:28:19 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:28:19 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:28:19 user nova-compute[72724]:       <nova:name>tempest-ServersNegativeTestJSON-server-997294747</nova:name>
Aug 17 16:28:19 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:28:19</nova:creationTime>
Aug 17 16:28:19 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:28:19 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:28:19 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:28:19 user nova-compute[72724]:       <nova:owner>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:user uuid="df91a9dc8e5b49f3bf2188ab3a96b1e8">tempest-ServersNegativeTestJSON-566124124-project-member</nova:user>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:project uuid="5fa57b31426d46ad8fa5351fe3ebb91e">tempest-ServersNegativeTestJSON-566124124</nova:project>
Aug 17 16:28:19 user nova-compute[72724]:       </nova:owner>
Aug 17 16:28:19 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:28:19 user nova-compute[72724]:       <nova:ports>
Aug 17 16:28:19 user nova-compute[72724]:         <nova:port uuid="08933904-896d-4a51-9df9-e7e9d168cd65">
Aug 17 16:28:19 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:28:19 user nova-compute[72724]:         </nova:port>
Aug 17 16:28:19 user nova-compute[72724]:       </nova:ports>
Aug 17 16:28:19 user nova-compute[72724]:     </nova:instance>
Aug 17 16:28:19 user nova-compute[72724]:   </metadata>
Aug 17 16:28:19 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:28:19 user nova-compute[72724]:     <system>
Aug 17 16:28:19 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:28:19 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:28:19 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:28:19 user nova-compute[72724]:       <entry name="serial">35b4fcf8-40f6-48b4-a785-c14a86027233</entry>
Aug 17 16:28:19 user nova-compute[72724]:       <entry name="uuid">35b4fcf8-40f6-48b4-a785-c14a86027233</entry>
Aug 17 16:28:19 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:28:19 user nova-compute[72724]:     </system>
Aug 17 16:28:19 user nova-compute[72724]:   </sysinfo>
Aug 17 16:28:19 user nova-compute[72724]:   <os>
Aug 17 16:28:19 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:28:19 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:28:19 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:28:19 user nova-compute[72724]:   </os>
Aug 17 16:28:19 user nova-compute[72724]:   <features>
Aug 17 16:28:19 user nova-compute[72724]:     <acpi/>
Aug 17 16:28:19 user nova-compute[72724]:     <apic/>
Aug 17 16:28:19 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:28:19 user nova-compute[72724]:   </features>
Aug 17 16:28:19 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:28:19 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:28:19 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:28:19 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:28:19 user nova-compute[72724]:   </clock>
Aug 17 16:28:19 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:28:19 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:28:19 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:28:19 user nova-compute[72724]:   </cpu>
Aug 17 16:28:19 user nova-compute[72724]:   <devices>
Aug 17 16:28:19 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:28:19 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:28:19 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk"/>
Aug 17 16:28:19 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:28:19 user nova-compute[72724]:     </disk>
Aug 17 16:28:19 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:28:19 user nova-compute[72724]:       <mac address="fa:16:3e:0c:3c:19"/>
Aug 17 16:28:19 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:28:19 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:28:19 user nova-compute[72724]:       <target dev="tap08933904-89"/>
Aug 17 16:28:19 user nova-compute[72724]:     </interface>
Aug 17 16:28:19 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:28:19 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/console.log" append="off"/>
Aug 17 16:28:19 user nova-compute[72724]:     </serial>
Aug 17 16:28:19 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:28:19 user nova-compute[72724]:     <video>
Aug 17 16:28:19 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:28:19 user nova-compute[72724]:     </video>
Aug 17 16:28:19 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:28:19 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:28:19 user nova-compute[72724]:     </rng>
Aug 17 16:28:19 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:28:19 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:28:19 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:28:19 user nova-compute[72724]:     </memballoon>
Aug 17 16:28:19 user nova-compute[72724]:   </devices>
Aug 17 16:28:19 user nova-compute[72724]: </domain>
Aug 17 16:28:19 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-997294747',display_name='tempest-ServersNegativeTestJSON-server-997294747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-997294747',id=17,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5fa57b31426d46ad8fa5351fe3ebb91e',ramdisk_id='',reservation_id='r-026hj5s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-566124124',owner_user_name='tempest-ServersNegativeTestJSON-566124124-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:28:17Z,user_data=None,user_id='df91a9dc8e5b49f3bf2188ab3a96b1e8',uuid=35b4fcf8-40f6-48b4-a785-c14a86027233,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converting VIF {"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG os_vif [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08933904-89, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08933904-89, col_values=(('external_ids', {'iface-id': '08933904-896d-4a51-9df9-e7e9d168cd65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:3c:19', 'vm-uuid': '35b4fcf8-40f6-48b4-a785-c14a86027233'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:19 user nova-compute[72724]: INFO os_vif [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89')
Aug 17 16:28:19 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Took 1.25 seconds to deallocate network for instance.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-46a8f1b6-2b87-4744-8102-894dd6441336 req-3d9443da-7dfc-4c8a-b377-a5969183e897 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Detach interface failed, port_id=af4682ae-3a41-498e-a6b5-90e3492b5e80, reason: Instance 254406ea-145e-40ff-8252-9e4a28db4892 could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] No VIF found with MAC fa:16:3e:0c:3c:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] swap_volume: Updating volume a944bb9f-65d9-423b-bf76-66f02bbeba14 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "WkxEMZAF", "auth_password": "gZzGRnMAPi0jF5", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "3e3e7d91-378d-4d52-bbab-97c2f48f7db9"}, "status": "reserved", "instance": "6d53a869-a011-47cc-ae06-9f499036bcc7", "attached_at": "", "detached_at": "", "volume_id": "3e3e7d91-378d-4d52-bbab-97c2f48f7db9", "serial": "3e3e7d91-378d-4d52-bbab-97c2f48f7db9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9', 'no_device': None, 'attachment_id': '2b9d6dbf-8768-4075-ac76-c49c0a4fe046'} {{(pid=72724) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-49f48595-9678-4319-8124-f54a1e5dc98c tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.052s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state deleted and task_state None.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state deleted and task_state None.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state deleted and task_state None.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-unplugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state deleted and task_state None.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Acquiring lock "254406ea-145e-40ff-8252-9e4a28db4892-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] Lock "254406ea-145e-40ff-8252-9e4a28db4892-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] No waiting events found dispatching network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:19 user nova-compute[72724]: WARNING nova.compute.manager [req-2f484857-709c-45ce-8cef-df3217163331 req-68e6a932-7228-49ef-8c90-831aa53c6d79 service nova] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Received unexpected event network-vif-plugged-af4682ae-3a41-498e-a6b5-90e3492b5e80 for instance with vm_state deleted and task_state None.
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Updated VIF entry in instance network info cache for port 08933904-896d-4a51-9df9-e7e9d168cd65. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG nova.network.neutron [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Updating instance_info_cache with network_info: [{"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8840df12-fd01-49a0-b314-242c5de02908 req-9a5328c3-e14a-4265-991d-5bc21f39b0cc service nova] Releasing lock "refresh_cache-35b4fcf8-40f6-48b4-a785-c14a86027233" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:28:19 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Deleted allocations for instance 254406ea-145e-40ff-8252-9e4a28db4892
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bf89fe5a-2cd9-4b69-8f9a-8d217578514b tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "254406ea-145e-40ff-8252-9e4a28db4892" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.935s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG os_brick.utils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[15488ed8-14fa-4995-9328-33d93392407e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc4caa1-415c-45a6-b726-e8bc14d42f10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a1ef17-5360-410c-8291-187ac17a0cc1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f4a0d3-a415-4cde-b31b-4d0b9f252e3e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:28:20 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:28:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eda188-a6d2-4ded-ae50-2849c8a3075a]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG os_brick.utils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:20 user nova-compute[72724]: INFO nova.compute.manager [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Swapping volume 3e3e7d91-378d-4d52-bbab-97c2f48f7db9 for a944bb9f-65d9-423b-bf76-66f02bbeba14
Aug 17 16:28:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff96d27b-a5cb-4f6b-9adf-68a5cbde06e2 req-70da1fda-eb93-4192-a925-ad1640465662 service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff96d27b-a5cb-4f6b-9adf-68a5cbde06e2 req-70da1fda-eb93-4192-a925-ad1640465662 service nova] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff96d27b-a5cb-4f6b-9adf-68a5cbde06e2 req-70da1fda-eb93-4192-a925-ad1640465662 service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff96d27b-a5cb-4f6b-9adf-68a5cbde06e2 req-70da1fda-eb93-4192-a925-ad1640465662 service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff96d27b-a5cb-4f6b-9adf-68a5cbde06e2 req-70da1fda-eb93-4192-a925-ad1640465662 service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] No waiting events found dispatching network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:21 user nova-compute[72724]: WARNING nova.compute.manager [req-ff96d27b-a5cb-4f6b-9adf-68a5cbde06e2 req-70da1fda-eb93-4192-a925-ad1640465662 service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received unexpected event network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 for instance with vm_state building and task_state spawning.
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289703.241101, 35b4fcf8-40f6-48b4-a785-c14a86027233 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] VM Resumed (Lifecycle Event)
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Instance spawned successfully.
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289703.2486649, 35b4fcf8-40f6-48b4-a785-c14a86027233 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] VM Started (Lifecycle Event)
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:23 user nova-compute[72724]: INFO nova.compute.manager [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Took 7.46 seconds to build instance.
Aug 17 16:28:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d4f76084-af0e-4c14-80ce-1773e31f685e tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.576s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-1eb28d04-05ac-4362-9749-7f68f30c9427 req-7607eb09-9d26-4066-8835-e534c0bd3957 service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1eb28d04-05ac-4362-9749-7f68f30c9427 req-7607eb09-9d26-4066-8835-e534c0bd3957 service nova] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1eb28d04-05ac-4362-9749-7f68f30c9427 req-7607eb09-9d26-4066-8835-e534c0bd3957 service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1eb28d04-05ac-4362-9749-7f68f30c9427 req-7607eb09-9d26-4066-8835-e534c0bd3957 service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-1eb28d04-05ac-4362-9749-7f68f30c9427 req-7607eb09-9d26-4066-8835-e534c0bd3957 service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] No waiting events found dispatching network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:23 user nova-compute[72724]: WARNING nova.compute.manager [req-1eb28d04-05ac-4362-9749-7f68f30c9427 req-7607eb09-9d26-4066-8835-e534c0bd3957 service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received unexpected event network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 for instance with vm_state active and task_state None.
Aug 17 16:28:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:26 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289691.347189, 75fd7469-8155-43cf-a93c-fac4132c8f03 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:26 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] VM Stopped (Lifecycle Event)
Aug 17 16:28:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-72825f8c-0eb7-4323-9048-04d7626b47d8 None None] [instance: 75fd7469-8155-43cf-a93c-fac4132c8f03] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 7e5312b5-8900-4739-a8a6-06efbcbc819c {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 333d38b1-26ec-4bd1-82d3-da202f339acb {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 35b4fcf8-40f6-48b4-a785-c14a86027233 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.092s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d53a869-a011-47cc-ae06-9f499036bcc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a944bb9f-65d9-423b-bf76-66f02bbeba14', 'serial': 'a944bb9f-65d9-423b-bf76-66f02bbeba14'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkxEMZAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9'}, 'status': 'reserved', 'instance': '6d53a869-a011-47cc-ae06-9f499036bcc7', 'attached_at': '', 'detached_at': '', 'volume_id': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9', 'serial'} {{(pid=72724) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:31 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[de466067-5b6c-40d9-88f7-9524fa3e4880]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:28:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc85d64-253c-4a7b-9c26-215c69f34125]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14] added
Aug 17 16:28:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5d090-2fae-4344-bc03-afa368245964]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89168f-4a29-4a84-aa0f-fe5345fff8e8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERHWbsqw {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ERHWbsqw" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdad262-b7fd-47b7-914b-86e7dd66003d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ERHWbsqw'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c4d17-3d9f-4d56-849c-7cc5e4e45378]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ada73f-26a2-4413-a22e-f1268845e729]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce32bca-e4b6-4b04-9289-8203c4454a5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]
Aug 17 16:28:31 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.
Aug 17 16:28:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3cd241-6ba1-41c2-8871-002c21ed118a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: INFO nova.compute.manager [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Rescuing
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67ffb7f-752d-430c-9252-9054f06bdc6e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:31 user nova-compute[72724]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:31 user nova-compute[72724]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61a93d0-8c5a-4399-b76a-219e0e798fdd]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:28:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-86dcdace-2572-4e9c-a5fe-dfe23c963adc req-3def7655-b036-48f4-9470-3bcf68a26efd service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-unplugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86dcdace-2572-4e9c-a5fe-dfe23c963adc req-3def7655-b036-48f4-9470-3bcf68a26efd service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86dcdace-2572-4e9c-a5fe-dfe23c963adc req-3def7655-b036-48f4-9470-3bcf68a26efd service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86dcdace-2572-4e9c-a5fe-dfe23c963adc req-3def7655-b036-48f4-9470-3bcf68a26efd service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-86dcdace-2572-4e9c-a5fe-dfe23c963adc req-3def7655-b036-48f4-9470-3bcf68a26efd service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-unplugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:32 user nova-compute[72724]: WARNING nova.compute.manager [req-86dcdace-2572-4e9c-a5fe-dfe23c963adc req-3def7655-b036-48f4-9470-3bcf68a26efd service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-unplugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state active and task_state rescuing.
Aug 17 16:28:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23036383735393837', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036383735393837', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:28:32 user nova-compute[72724]: DEBUG nova.objects.instance [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lazy-loading 'flavor' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance destroyed successfully.
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289698.000292, 254406ea-145e-40ff-8252-9e4a28db4892 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:33 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] VM Stopped (Lifecycle Event)
Aug 17 16:28:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Attempting rescue
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72724) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:28:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Creating image(s)
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'trusted_certs' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7b1b4ed6-2aca-4aa2-9e4c-4d73161b80f4 None None] [instance: 254406ea-145e-40ff-8252-9e4a28db4892] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue" returned: 0 in 0.048s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'migration_context' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Start _get_guest_xml network_info=[{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:f4:84:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'resources' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'numa_topology' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:33 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:33 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'vcpu_model' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 11534336 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220067116',display_name='tempest-ServerRescueNegativeTestJSON-server-220067116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220067116',id=15,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-c10ke00q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:50Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=59a5dee3-bf14-4196-a8da-c9ea471c0752,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:f4:84:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:f4:84:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'pci_devices' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:28:33 user nova-compute[72724]:   <uuid>59a5dee3-bf14-4196-a8da-c9ea471c0752</uuid>
Aug 17 16:28:33 user nova-compute[72724]:   <name>instance-0000000f</name>
Aug 17 16:28:33 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:28:33 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:28:33 user nova-compute[72724]:   <metadata>
Aug 17 16:28:33 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:28:33 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:28:33 user nova-compute[72724]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-220067116</nova:name>
Aug 17 16:28:33 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:28:33</nova:creationTime>
Aug 17 16:28:33 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:28:33 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:28:33 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:28:33 user nova-compute[72724]:       <nova:owner>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:user uuid="558eaa9f170b40978f6004f1e6aff3e9">tempest-ServerRescueNegativeTestJSON-2097085369-project-member</nova:user>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:project uuid="c4767040317048ddb4479fa7c82f3384">tempest-ServerRescueNegativeTestJSON-2097085369</nova:project>
Aug 17 16:28:33 user nova-compute[72724]:       </nova:owner>
Aug 17 16:28:33 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:28:33 user nova-compute[72724]:       <nova:ports>
Aug 17 16:28:33 user nova-compute[72724]:         <nova:port uuid="853dcaac-14ef-4365-9613-97c8afbbc55a">
Aug 17 16:28:33 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:28:33 user nova-compute[72724]:         </nova:port>
Aug 17 16:28:33 user nova-compute[72724]:       </nova:ports>
Aug 17 16:28:33 user nova-compute[72724]:     </nova:instance>
Aug 17 16:28:33 user nova-compute[72724]:   </metadata>
Aug 17 16:28:33 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:28:33 user nova-compute[72724]:     <system>
Aug 17 16:28:33 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:28:33 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:28:33 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:28:33 user nova-compute[72724]:       <entry name="serial">59a5dee3-bf14-4196-a8da-c9ea471c0752</entry>
Aug 17 16:28:33 user nova-compute[72724]:       <entry name="uuid">59a5dee3-bf14-4196-a8da-c9ea471c0752</entry>
Aug 17 16:28:33 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:28:33 user nova-compute[72724]:     </system>
Aug 17 16:28:33 user nova-compute[72724]:   </sysinfo>
Aug 17 16:28:33 user nova-compute[72724]:   <os>
Aug 17 16:28:33 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:28:33 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:28:33 user nova-compute[72724]:   </os>
Aug 17 16:28:33 user nova-compute[72724]:   <features>
Aug 17 16:28:33 user nova-compute[72724]:     <acpi/>
Aug 17 16:28:33 user nova-compute[72724]:     <apic/>
Aug 17 16:28:33 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:28:33 user nova-compute[72724]:   </features>
Aug 17 16:28:33 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:28:33 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:28:33 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:28:33 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:28:33 user nova-compute[72724]:   </clock>
Aug 17 16:28:33 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:28:33 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:28:33 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:28:33 user nova-compute[72724]:   </cpu>
Aug 17 16:28:33 user nova-compute[72724]:   <devices>
Aug 17 16:28:33 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:28:33 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:28:33 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue"/>
Aug 17 16:28:33 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:28:33 user nova-compute[72724]:     </disk>
Aug 17 16:28:33 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:28:33 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:28:33 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk"/>
Aug 17 16:28:33 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:28:33 user nova-compute[72724]:     </disk>
Aug 17 16:28:33 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:28:33 user nova-compute[72724]:       <mac address="fa:16:3e:f4:84:5a"/>
Aug 17 16:28:33 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:28:33 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:28:33 user nova-compute[72724]:       <target dev="tap853dcaac-14"/>
Aug 17 16:28:33 user nova-compute[72724]:     </interface>
Aug 17 16:28:33 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:28:33 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/console.log" append="off"/>
Aug 17 16:28:33 user nova-compute[72724]:     </serial>
Aug 17 16:28:33 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:28:33 user nova-compute[72724]:     <video>
Aug 17 16:28:33 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:28:33 user nova-compute[72724]:     </video>
Aug 17 16:28:33 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:28:33 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:28:33 user nova-compute[72724]:     </rng>
Aug 17 16:28:33 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:28:33 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:28:33 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:28:33 user nova-compute[72724]:     </memballoon>
Aug 17 16:28:33 user nova-compute[72724]:   </devices>
Aug 17 16:28:33 user nova-compute[72724]: </domain>
Aug 17 16:28:33 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:28:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance destroyed successfully.
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:f4:84:5a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:28:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 354418688 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-e95bb68d-8c1c-412a-93f5-4f7a449a19ef req-2e3a53cd-f65b-4688-8445-685a3436e543 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e95bb68d-8c1c-412a-93f5-4f7a449a19ef req-2e3a53cd-f65b-4688-8445-685a3436e543 service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e95bb68d-8c1c-412a-93f5-4f7a449a19ef req-2e3a53cd-f65b-4688-8445-685a3436e543 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e95bb68d-8c1c-412a-93f5-4f7a449a19ef req-2e3a53cd-f65b-4688-8445-685a3436e543 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-e95bb68d-8c1c-412a-93f5-4f7a449a19ef req-2e3a53cd-f65b-4688-8445-685a3436e543 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:34 user nova-compute[72724]: WARNING nova.compute.manager [req-e95bb68d-8c1c-412a-93f5-4f7a449a19ef req-2e3a53cd-f65b-4688-8445-685a3436e543 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state active and task_state rescuing.
Aug 17 16:28:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:28:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 537919488 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 706740224 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 879755264 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 1049624576 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:36 user nova-compute[72724]: WARNING nova.compute.manager [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state active and task_state rescuing.
Aug 17 16:28:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:36 user nova-compute[72724]: WARNING nova.compute.manager [req-3545937a-159d-47f0-99f6-dc5bc7deac92 req-8066a42d-dd46-444c-8220-1925a1d4496b service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state active and task_state rescuing.
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WkxEMZAF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '3e3e7d91-378d-4d52-bbab-97c2f48f7db9'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:37 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab260b0-b8cd-4ea2-9eb5-04ac461f8120]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d72bdf3-e0e3-4fc0-a8bd-0a27908c77aa]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:37 user nova-compute[72724]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:37 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 (non-flash)
Aug 17 16:28:37 user nova-compute[72724]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:37 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86a6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08b5ce1-0d57-4b0b-a50f-4e4fda553161]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd6a370-0ad0-4b81-bbd6-3f5ea2b07746]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a780f-cde1-455b-89bb-1affa8c4cbdb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37199fc-7274-4685-8523-84b513da044c]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b570579-e32c-4251-9f1d-a285e036020d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f148278e-cad3-4b51-a53f-deeba0e4d3b6]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260]
Aug 17 16:28:37 user nova-compute[72724]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9, portal: 172.16.0.220,3260] successful.
Aug 17 16:28:37 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e3e7d91-378d-4d52-bbab-97c2f48f7db9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e81cdc-80c6-4ae0-a2cd-df031024aa59]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] <== disconnect_volume: return (356ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '6d53a869-a011-47cc-ae06-9f499036bcc7', 'attached_at': '', 'detached_at': '', 'volume_id': 'a944bb9f-65d9-423b-bf76-66f02bbeba14', 'serial'} {{(pid=72724) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] swap_volume: removing Cinder connection for volume 3e3e7d91-378d-4d52-bbab-97c2f48f7db9 {{(pid=72724) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 59a5dee3-bf14-4196-a8da-c9ea471c0752 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289718.1346552, 59a5dee3-bf14-4196-a8da-c9ea471c0752 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:38 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] VM Resumed (Lifecycle Event)
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f0ccaf16-599e-44cd-a663-eb42787f5586 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:28:38 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289718.1400368, 59a5dee3-bf14-4196-a8da-c9ea471c0752 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:38 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] VM Started (Lifecycle Event)
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] swap_volume: Updating volume 3e3e7d91-378d-4d52-bbab-97c2f48f7db9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "ERHWbsqw", "auth_password": "jabS72xdgYqQCk", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "a944bb9f-65d9-423b-bf76-66f02bbeba14"}, "status": "reserved", "instance": "6d53a869-a011-47cc-ae06-9f499036bcc7", "attached_at": "", "detached_at": "", "volume_id": "a944bb9f-65d9-423b-bf76-66f02bbeba14", "serial": "a944bb9f-65d9-423b-bf76-66f02bbeba14"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a944bb9f-65d9-423b-bf76-66f02bbeba14', 'no_device': None, 'attachment_id': 'de88231b-cc27-4070-9f83-07509be20329'} {{(pid=72724) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-617a94bb-1e56-4dcb-8a6b-0074eab2c741 tempest-TestVolumeSwap-1159545551 tempest-TestVolumeSwap-1159545551-project-admin] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.232s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 10.262s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.219s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: INFO nova.compute.manager [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Detaching volume a944bb9f-65d9-423b-bf76-66f02bbeba14
Aug 17 16:28:39 user nova-compute[72724]: INFO nova.virt.block_device [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Attempting to driver detach volume a944bb9f-65d9-423b-bf76-66f02bbeba14 from mountpoint /dev/vdb
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Attempting to detach device vdb from instance 6d53a869-a011-47cc-ae06-9f499036bcc7 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:28:39 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:28:39 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:28:39 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:28:39 user nova-compute[72724]:   <serial>a944bb9f-65d9-423b-bf76-66f02bbeba14</serial>
Aug 17 16:28:39 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:28:39 user nova-compute[72724]: </disk>
Aug 17 16:28:39 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:28:39 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Successfully detached device vdb from instance 6d53a869-a011-47cc-ae06-9f499036bcc7 from the persistent domain config.
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d53a869-a011-47cc-ae06-9f499036bcc7 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:28:39 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:28:39 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:28:39 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:28:39 user nova-compute[72724]:   <serial>a944bb9f-65d9-423b-bf76-66f02bbeba14</serial>
Aug 17 16:28:39 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:28:39 user nova-compute[72724]: </disk>
Aug 17 16:28:39 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692289719.835124, 6d53a869-a011-47cc-ae06-9f499036bcc7 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:28:39 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Successfully detached device vdb from instance 6d53a869-a011-47cc-ae06-9f499036bcc7 from the live domain config.
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ERHWbsqw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'a944bb9f-65d9-423b-bf76-66f02bbeba14'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:28:39 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:28:39 user nova-compute[72724]: INFO nova.compute.claims [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Claim successful on node user
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7466c45b-68a6-4b47-a5e6-8893116ef8ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[866a31a3-d5fa-4061-a4d1-e9c81175a0ac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 (non-flash)
Aug 17 16:28:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c868c1f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[259bc23b-d222-4597-8bd2-1bd6f4c5436d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfdcaab-262d-4965-b5cd-5b8a100353c2]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37abe0-24d0-4ca1-a961-7fffff241ec3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0235ad2d-14e3-4a2a-9a14-360d23036037]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[da898351-3697-457c-a5bc-a4af451e7aaf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a394d89-eb2a-43c5-ad49-1f4f1ddc7cb5]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260]
Aug 17 16:28:40 user nova-compute[72724]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14, portal: 172.16.0.220,3260] successful.
Aug 17 16:28:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:40 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:40 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7782MB free_disk=25.64358139038086GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a944bb9f-65d9-423b-bf76-66f02bbeba14 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[db77203a-36f4-4b57-9e47-ef8b78e544b8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.756s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] <== disconnect_volume: return (757ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.915s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.187s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:28:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance bab1abaa-414c-4c50-ae78-be9126d9aafc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6d53a869-a011-47cc-ae06-9f499036bcc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 35b4fcf8-40f6-48b4-a785-c14a86027233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 83f9af1c-ac8e-4164-8099-59b353263047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:28:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.policy [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd44441d94d244ec5a0e0b00617a3229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4518061f274934833bc6801498ec91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:28:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Creating image(s)
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.576s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk 1073741824" returned: 0 in 0.049s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lazy-loading 'flavor' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d520a03c-e633-48f4-877e-8713642550ee tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.414s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Cannot resize image /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'migration_context' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Ensure instance console log exists: /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Successfully created port: 1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Successfully updated port: 1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-changed-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Refreshing instance network info cache due to event network-changed-1380c6c7-265d-4064-9302-6c037bb6684c. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] Acquiring lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:28:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updating instance_info_cache with network_info: [{"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance network_info: |[{"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] Acquired lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Refreshing network info cache for port 1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Start _get_guest_xml network_info=[{"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:28:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1821486414',display_name='tempest-tempest.common.compute-instance-1821486414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1821486414',id=18,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHXLwwxkDku5rfnP8iYXTIEqll3oksBJas5Od/7/rp7seEVlxZtrleII/0owGqphwukPIlWXazaavg1ZJNT2OUGOxT7wuEMTgxdn/HAhS2rlB0gZ41Sp66cQeSkkAHL9A==',key_name='tempest-keypair-1823955780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-0gnojs1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=83f9af1c-ac8e-4164-8099-59b353263047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_devices' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:28:43 user nova-compute[72724]:   <uuid>83f9af1c-ac8e-4164-8099-59b353263047</uuid>
Aug 17 16:28:43 user nova-compute[72724]:   <name>instance-00000012</name>
Aug 17 16:28:43 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:28:43 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:28:43 user nova-compute[72724]:   <metadata>
Aug 17 16:28:43 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:28:43 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:28:43 user nova-compute[72724]:       <nova:name>tempest-tempest.common.compute-instance-1821486414</nova:name>
Aug 17 16:28:43 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:28:43</nova:creationTime>
Aug 17 16:28:43 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:28:43 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:28:43 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:28:43 user nova-compute[72724]:       <nova:owner>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:user uuid="d44441d94d244ec5a0e0b00617a3229f">tempest-ServerActionsTestOtherA-2020786536-project-member</nova:user>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:project uuid="6f4518061f274934833bc6801498ec91">tempest-ServerActionsTestOtherA-2020786536</nova:project>
Aug 17 16:28:43 user nova-compute[72724]:       </nova:owner>
Aug 17 16:28:43 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:28:43 user nova-compute[72724]:       <nova:ports>
Aug 17 16:28:43 user nova-compute[72724]:         <nova:port uuid="1380c6c7-265d-4064-9302-6c037bb6684c">
Aug 17 16:28:43 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:28:43 user nova-compute[72724]:         </nova:port>
Aug 17 16:28:43 user nova-compute[72724]:       </nova:ports>
Aug 17 16:28:43 user nova-compute[72724]:     </nova:instance>
Aug 17 16:28:43 user nova-compute[72724]:   </metadata>
Aug 17 16:28:43 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:28:43 user nova-compute[72724]:     <system>
Aug 17 16:28:43 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:28:43 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:28:43 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:28:43 user nova-compute[72724]:       <entry name="serial">83f9af1c-ac8e-4164-8099-59b353263047</entry>
Aug 17 16:28:43 user nova-compute[72724]:       <entry name="uuid">83f9af1c-ac8e-4164-8099-59b353263047</entry>
Aug 17 16:28:43 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:28:43 user nova-compute[72724]:     </system>
Aug 17 16:28:43 user nova-compute[72724]:   </sysinfo>
Aug 17 16:28:43 user nova-compute[72724]:   <os>
Aug 17 16:28:43 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:28:43 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:28:43 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:28:43 user nova-compute[72724]:   </os>
Aug 17 16:28:43 user nova-compute[72724]:   <features>
Aug 17 16:28:43 user nova-compute[72724]:     <acpi/>
Aug 17 16:28:43 user nova-compute[72724]:     <apic/>
Aug 17 16:28:43 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:28:43 user nova-compute[72724]:   </features>
Aug 17 16:28:43 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:28:43 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:28:43 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:28:43 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:28:43 user nova-compute[72724]:   </clock>
Aug 17 16:28:43 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:28:43 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:28:43 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:28:43 user nova-compute[72724]:   </cpu>
Aug 17 16:28:43 user nova-compute[72724]:   <devices>
Aug 17 16:28:43 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:28:43 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:28:43 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk"/>
Aug 17 16:28:43 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:28:43 user nova-compute[72724]:     </disk>
Aug 17 16:28:43 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:28:43 user nova-compute[72724]:       <mac address="fa:16:3e:58:aa:15"/>
Aug 17 16:28:43 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:28:43 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:28:43 user nova-compute[72724]:       <target dev="tap1380c6c7-26"/>
Aug 17 16:28:43 user nova-compute[72724]:     </interface>
Aug 17 16:28:43 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:28:43 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/console.log" append="off"/>
Aug 17 16:28:43 user nova-compute[72724]:     </serial>
Aug 17 16:28:43 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:28:43 user nova-compute[72724]:     <video>
Aug 17 16:28:43 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:28:43 user nova-compute[72724]:     </video>
Aug 17 16:28:43 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:28:43 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:28:43 user nova-compute[72724]:     </rng>
Aug 17 16:28:43 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:28:43 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:28:43 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:28:43 user nova-compute[72724]:     </memballoon>
Aug 17 16:28:43 user nova-compute[72724]:   </devices>
Aug 17 16:28:43 user nova-compute[72724]: </domain>
Aug 17 16:28:43 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1821486414',display_name='tempest-tempest.common.compute-instance-1821486414',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1821486414',id=18,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHXLwwxkDku5rfnP8iYXTIEqll3oksBJas5Od/7/rp7seEVlxZtrleII/0owGqphwukPIlWXazaavg1ZJNT2OUGOxT7wuEMTgxdn/HAhS2rlB0gZ41Sp66cQeSkkAHL9A==',key_name='tempest-keypair-1823955780',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-0gnojs1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=83f9af1c-ac8e-4164-8099-59b353263047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG os_vif [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1380c6c7-26, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1380c6c7-26, col_values=(('external_ids', {'iface-id': '1380c6c7-265d-4064-9302-6c037bb6684c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:aa:15', 'vm-uuid': '83f9af1c-ac8e-4164-8099-59b353263047'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:43 user nova-compute[72724]: INFO os_vif [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26')
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No VIF found with MAC fa:16:3e:58:aa:15, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updated VIF entry in instance network info cache for port 1380c6c7-265d-4064-9302-6c037bb6684c. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updating instance_info_cache with network_info: [{"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5ce0c9d6-6873-4ebc-92b2-a6e409d83fa1 req-66bc62f8-5f90-4b00-9772-23dfb945b6a8 service nova] Releasing lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-3059a264-a92e-4f8f-8598-6a8e8953e4c2 req-f12598f1-b666-43e0-a23e-9476489cd33b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3059a264-a92e-4f8f-8598-6a8e8953e4c2 req-f12598f1-b666-43e0-a23e-9476489cd33b service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3059a264-a92e-4f8f-8598-6a8e8953e4c2 req-f12598f1-b666-43e0-a23e-9476489cd33b service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3059a264-a92e-4f8f-8598-6a8e8953e4c2 req-f12598f1-b666-43e0-a23e-9476489cd33b service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-3059a264-a92e-4f8f-8598-6a8e8953e4c2 req-f12598f1-b666-43e0-a23e-9476489cd33b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:44 user nova-compute[72724]: WARNING nova.compute.manager [req-3059a264-a92e-4f8f-8598-6a8e8953e4c2 req-f12598f1-b666-43e0-a23e-9476489cd33b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state building and task_state spawning.
Aug 17 16:28:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289726.8817039, 83f9af1c-ac8e-4164-8099-59b353263047 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] VM Resumed (Lifecycle Event)
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:28:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance spawned successfully.
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:28:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289726.8837557, 83f9af1c-ac8e-4164-8099-59b353263047 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:28:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] VM Started (Lifecycle Event)
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:28:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-6876ac9a-a9a7-4a2c-a637-71e3aaf13062 req-1a3f34c5-4fba-4075-9beb-7b365b97e04a service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6876ac9a-a9a7-4a2c-a637-71e3aaf13062 req-1a3f34c5-4fba-4075-9beb-7b365b97e04a service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6876ac9a-a9a7-4a2c-a637-71e3aaf13062 req-1a3f34c5-4fba-4075-9beb-7b365b97e04a service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6876ac9a-a9a7-4a2c-a637-71e3aaf13062 req-1a3f34c5-4fba-4075-9beb-7b365b97e04a service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-6876ac9a-a9a7-4a2c-a637-71e3aaf13062 req-1a3f34c5-4fba-4075-9beb-7b365b97e04a service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:47 user nova-compute[72724]: WARNING nova.compute.manager [req-6876ac9a-a9a7-4a2c-a637-71e3aaf13062 req-1a3f34c5-4fba-4075-9beb-7b365b97e04a service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state building and task_state spawning.
Aug 17 16:28:47 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:28:47 user nova-compute[72724]: INFO nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Took 6.01 seconds to spawn the instance on the hypervisor.
Aug 17 16:28:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:28:47 user nova-compute[72724]: INFO nova.compute.manager [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Took 7.28 seconds to build instance.
Aug 17 16:28:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa2f7517-545e-45f1-8e5a-e4ffbc2a2875 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.424s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:53 user nova-compute[72724]: INFO nova.compute.manager [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Terminating instance
Aug 17 16:28:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Instance destroyed successfully.
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lazy-loading 'resources' on Instance uuid bab1abaa-414c-4c50-ae78-be9126d9aafc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:21:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-582266070',display_name='tempest-ServerStableDeviceRescueTest-server-582266070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-582266070',id=2,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHIj+ap/KOFchCg9v9kt6fYGpAv+Mvxn0PJW/oauRh73tKZWQAsQ4FM9ZriNj8mncH9E1li97b38WzbNB5Dm6dP7hywQlbsLzeTK9viM3b8J9CU24Q41zNAmpx3cVQXjJQ==',key_name='tempest-keypair-1867058309',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:25:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e8428c63a474e2bb1d26c44c7a0e2c1',ramdisk_id='',reservation_id='r-m0z751gb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-890446162',owner_user_name='tempest-ServerStableDeviceRescueTest-890446162-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:27:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d21c9e7f6c3546fbaabef5fef9ba367e',uuid=bab1abaa-414c-4c50-ae78-be9126d9aafc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converting VIF {"id": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "address": "fa:16:3e:9b:aa:68", "network": {"id": "1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1055916925-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e8428c63a474e2bb1d26c44c7a0e2c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d1dd947-fb", "ovs_interfaceid": "7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG os_vif [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7d1dd947-fb, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:28:54 user nova-compute[72724]: INFO os_vif [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:aa:68,bridge_name='br-int',has_traffic_filtering=True,id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d,network=Network(1f7cb5ca-ba63-4c6e-8555-1f4d4352bb0f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d1dd947-fb')
Aug 17 16:28:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Deleting instance files /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc_del
Aug 17 16:28:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Deletion of /opt/stack/data/nova/instances/bab1abaa-414c-4c50-ae78-be9126d9aafc_del complete
Aug 17 16:28:54 user nova-compute[72724]: INFO nova.compute.manager [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 16:28:54 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-5cc610bb-01c0-4e71-bbf7-34369254ebdb req-83c129d9-8fd2-4d75-8a44-4dfcfd855be6 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5cc610bb-01c0-4e71-bbf7-34369254ebdb req-83c129d9-8fd2-4d75-8a44-4dfcfd855be6 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5cc610bb-01c0-4e71-bbf7-34369254ebdb req-83c129d9-8fd2-4d75-8a44-4dfcfd855be6 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5cc610bb-01c0-4e71-bbf7-34369254ebdb req-83c129d9-8fd2-4d75-8a44-4dfcfd855be6 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-5cc610bb-01c0-4e71-bbf7-34369254ebdb req-83c129d9-8fd2-4d75-8a44-4dfcfd855be6 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-5cc610bb-01c0-4e71-bbf7-34369254ebdb req-83c129d9-8fd2-4d75-8a44-4dfcfd855be6 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-unplugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:55 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Took 0.94 seconds to deallocate network for instance.
Aug 17 16:28:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-b0b778d7-e2a7-4986-97b2-4ae5171da6fc req-11d70cb4-024c-49a8-bc12-3527c4934461 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-deleted-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:55 user nova-compute[72724]: INFO nova.compute.manager [req-b0b778d7-e2a7-4986-97b2-4ae5171da6fc req-11d70cb4-024c-49a8-bc12-3527c4934461 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Neutron deleted interface 7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d; detaching it from the instance and deleting it from the info cache
Aug 17 16:28:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-b0b778d7-e2a7-4986-97b2-4ae5171da6fc req-11d70cb4-024c-49a8-bc12-3527c4934461 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-b0b778d7-e2a7-4986-97b2-4ae5171da6fc req-11d70cb4-024c-49a8-bc12-3527c4934461 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Detach interface failed, port_id=7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d, reason: Instance bab1abaa-414c-4c50-ae78-be9126d9aafc could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:55 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Deleted allocations for instance bab1abaa-414c-4c50-ae78-be9126d9aafc
Aug 17 16:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cbcdeec0-6114-4c47-8094-14e0ed26edbb tempest-ServerStableDeviceRescueTest-890446162 tempest-ServerStableDeviceRescueTest-890446162-project-member] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:28:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-2243c36d-2eb0-4f6c-9a89-2c534c077f55 req-2c62e299-95be-4a4e-863f-eeedfdc6cd28 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2243c36d-2eb0-4f6c-9a89-2c534c077f55 req-2c62e299-95be-4a4e-863f-eeedfdc6cd28 service nova] Acquiring lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2243c36d-2eb0-4f6c-9a89-2c534c077f55 req-2c62e299-95be-4a4e-863f-eeedfdc6cd28 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2243c36d-2eb0-4f6c-9a89-2c534c077f55 req-2c62e299-95be-4a4e-863f-eeedfdc6cd28 service nova] Lock "bab1abaa-414c-4c50-ae78-be9126d9aafc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:28:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-2243c36d-2eb0-4f6c-9a89-2c534c077f55 req-2c62e299-95be-4a4e-863f-eeedfdc6cd28 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] No waiting events found dispatching network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:28:56 user nova-compute[72724]: WARNING nova.compute.manager [req-2243c36d-2eb0-4f6c-9a89-2c534c077f55 req-2c62e299-95be-4a4e-863f-eeedfdc6cd28 service nova] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Received unexpected event network-vif-plugged-7d1dd947-fb0a-4d0e-b1f7-5b27abf5136d for instance with vm_state deleted and task_state None.
Aug 17 16:28:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:09 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289734.0252004, bab1abaa-414c-4c50-ae78-be9126d9aafc => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:29:09 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] VM Stopped (Lifecycle Event)
Aug 17 16:29:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b6469c78-3f53-4ee4-bb2b-90410c378587 None None] [instance: bab1abaa-414c-4c50-ae78-be9126d9aafc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:29:11 user nova-compute[72724]: INFO nova.compute.claims [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Claim successful on node user
Aug 17 16:29:11 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:29:11 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.551s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:29:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.policy [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8041c5cb8ad64f64b31aab70052e4f02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '43b9b4c4d963430e95e8b6fb484c9889', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:29:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Creating image(s)
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk 1073741824" returned: 0 in 0.060s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Checking if we can resize image /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Successfully created port: 3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Cannot resize image /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'migration_context' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Ensure instance console log exists: /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Successfully updated port: 3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing instance network info cache due to event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:29:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance network_info: |[{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.network.neutron [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Start _get_guest_xml network_info=[{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:29:14 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:29:14 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-336069617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-336069617',id=19,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5YB99VGoL3C3YdDwPY4qPwMFdUgKGIXY4faMBXjKJkjNyuqAANHxfNjGVk4UBrSA8bu4w1Xlk3KtWBh7CWLLyipmf0SGDC5vy5q6kux/27Jsq/NiqNKuMFHHvasvzFBw==',key_name='tempest-keypair-11081656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-ok1ep51j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=194a5ac4-9157-49c2-beeb-86698432abb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'pci_devices' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:29:14 user nova-compute[72724]:   <uuid>194a5ac4-9157-49c2-beeb-86698432abb3</uuid>
Aug 17 16:29:14 user nova-compute[72724]:   <name>instance-00000013</name>
Aug 17 16:29:14 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:29:14 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:29:14 user nova-compute[72724]:   <metadata>
Aug 17 16:29:14 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:29:14 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:29:14 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-336069617</nova:name>
Aug 17 16:29:14 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:29:14</nova:creationTime>
Aug 17 16:29:14 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:29:14 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:29:14 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:29:14 user nova-compute[72724]:       <nova:owner>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:user uuid="8041c5cb8ad64f64b31aab70052e4f02">tempest-AttachVolumeShelveTestJSON-239110034-project-member</nova:user>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:project uuid="43b9b4c4d963430e95e8b6fb484c9889">tempest-AttachVolumeShelveTestJSON-239110034</nova:project>
Aug 17 16:29:14 user nova-compute[72724]:       </nova:owner>
Aug 17 16:29:14 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:29:14 user nova-compute[72724]:       <nova:ports>
Aug 17 16:29:14 user nova-compute[72724]:         <nova:port uuid="3be4c18a-383a-464f-a54e-dde317ef8fb4">
Aug 17 16:29:14 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 16:29:14 user nova-compute[72724]:         </nova:port>
Aug 17 16:29:14 user nova-compute[72724]:       </nova:ports>
Aug 17 16:29:14 user nova-compute[72724]:     </nova:instance>
Aug 17 16:29:14 user nova-compute[72724]:   </metadata>
Aug 17 16:29:14 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:29:14 user nova-compute[72724]:     <system>
Aug 17 16:29:14 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:29:14 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:29:14 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:29:14 user nova-compute[72724]:       <entry name="serial">194a5ac4-9157-49c2-beeb-86698432abb3</entry>
Aug 17 16:29:14 user nova-compute[72724]:       <entry name="uuid">194a5ac4-9157-49c2-beeb-86698432abb3</entry>
Aug 17 16:29:14 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:29:14 user nova-compute[72724]:     </system>
Aug 17 16:29:14 user nova-compute[72724]:   </sysinfo>
Aug 17 16:29:14 user nova-compute[72724]:   <os>
Aug 17 16:29:14 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:29:14 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:29:14 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:29:14 user nova-compute[72724]:   </os>
Aug 17 16:29:14 user nova-compute[72724]:   <features>
Aug 17 16:29:14 user nova-compute[72724]:     <acpi/>
Aug 17 16:29:14 user nova-compute[72724]:     <apic/>
Aug 17 16:29:14 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:29:14 user nova-compute[72724]:   </features>
Aug 17 16:29:14 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:29:14 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:29:14 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:29:14 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:29:14 user nova-compute[72724]:   </clock>
Aug 17 16:29:14 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:29:14 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:29:14 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:29:14 user nova-compute[72724]:   </cpu>
Aug 17 16:29:14 user nova-compute[72724]:   <devices>
Aug 17 16:29:14 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:29:14 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:29:14 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk"/>
Aug 17 16:29:14 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:29:14 user nova-compute[72724]:     </disk>
Aug 17 16:29:14 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:29:14 user nova-compute[72724]:       <mac address="fa:16:3e:04:93:1d"/>
Aug 17 16:29:14 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:29:14 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:29:14 user nova-compute[72724]:       <target dev="tap3be4c18a-38"/>
Aug 17 16:29:14 user nova-compute[72724]:     </interface>
Aug 17 16:29:14 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:29:14 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/console.log" append="off"/>
Aug 17 16:29:14 user nova-compute[72724]:     </serial>
Aug 17 16:29:14 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:29:14 user nova-compute[72724]:     <video>
Aug 17 16:29:14 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:29:14 user nova-compute[72724]:     </video>
Aug 17 16:29:14 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:29:14 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:29:14 user nova-compute[72724]:     </rng>
Aug 17 16:29:14 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:29:14 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:29:14 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:29:14 user nova-compute[72724]:     </memballoon>
Aug 17 16:29:14 user nova-compute[72724]:   </devices>
Aug 17 16:29:14 user nova-compute[72724]: </domain>
Aug 17 16:29:14 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-336069617',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-336069617',id=19,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5YB99VGoL3C3YdDwPY4qPwMFdUgKGIXY4faMBXjKJkjNyuqAANHxfNjGVk4UBrSA8bu4w1Xlk3KtWBh7CWLLyipmf0SGDC5vy5q6kux/27Jsq/NiqNKuMFHHvasvzFBw==',key_name='tempest-keypair-11081656',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-ok1ep51j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:29:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=194a5ac4-9157-49c2-beeb-86698432abb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG os_vif [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3be4c18a-38, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3be4c18a-38, col_values=(('external_ids', {'iface-id': '3be4c18a-383a-464f-a54e-dde317ef8fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:93:1d', 'vm-uuid': '194a5ac4-9157-49c2-beeb-86698432abb3'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:14 user nova-compute[72724]: INFO os_vif [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38')
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:29:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No VIF found with MAC fa:16:3e:04:93:1d, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG nova.network.neutron [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updated VIF entry in instance network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG nova.network.neutron [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-83ed1af2-35e1-4acb-aed8-a797428ea320 req-1225074b-a989-407e-90b7-ea25002b98e5 service nova] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:17 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289757.9478772, 194a5ac4-9157-49c2-beeb-86698432abb3 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:29:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] VM Resumed (Lifecycle Event)
Aug 17 16:29:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:29:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:29:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance spawned successfully.
Aug 17 16:29:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:29:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:18 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289757.9520626, 194a5ac4-9157-49c2-beeb-86698432abb3 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:29:18 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] VM Started (Lifecycle Event)
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:29:18 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:29:18 user nova-compute[72724]: INFO nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Took 5.91 seconds to spawn the instance on the hypervisor.
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:18 user nova-compute[72724]: INFO nova.compute.manager [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Took 6.80 seconds to build instance.
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-fb9ed1b0-b2d8-4c19-a884-bfd76c0060cb req-8282d298-fc3f-46dc-b54b-f8bfbc46c21b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fb9ed1b0-b2d8-4c19-a884-bfd76c0060cb req-8282d298-fc3f-46dc-b54b-f8bfbc46c21b service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fb9ed1b0-b2d8-4c19-a884-bfd76c0060cb req-8282d298-fc3f-46dc-b54b-f8bfbc46c21b service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fb9ed1b0-b2d8-4c19-a884-bfd76c0060cb req-8282d298-fc3f-46dc-b54b-f8bfbc46c21b service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-fb9ed1b0-b2d8-4c19-a884-bfd76c0060cb req-8282d298-fc3f-46dc-b54b-f8bfbc46c21b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:29:18 user nova-compute[72724]: WARNING nova.compute.manager [req-fb9ed1b0-b2d8-4c19-a884-bfd76c0060cb req-8282d298-fc3f-46dc-b54b-f8bfbc46c21b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state active and task_state None.
Aug 17 16:29:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f5d5ceb2-aed1-4ae3-a392-371691bcfa5f tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.912s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-283669d6-0191-47c0-a263-3dd9972e8f50 req-6c7ffb4d-2d7e-428b-b3f6-efd9088ad0aa service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-283669d6-0191-47c0-a263-3dd9972e8f50 req-6c7ffb4d-2d7e-428b-b3f6-efd9088ad0aa service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-283669d6-0191-47c0-a263-3dd9972e8f50 req-6c7ffb4d-2d7e-428b-b3f6-efd9088ad0aa service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-283669d6-0191-47c0-a263-3dd9972e8f50 req-6c7ffb4d-2d7e-428b-b3f6-efd9088ad0aa service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-283669d6-0191-47c0-a263-3dd9972e8f50 req-6c7ffb4d-2d7e-428b-b3f6-efd9088ad0aa service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:29:20 user nova-compute[72724]: WARNING nova.compute.manager [req-283669d6-0191-47c0-a263-3dd9972e8f50 req-6c7ffb4d-2d7e-428b-b3f6-efd9088ad0aa service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state active and task_state None.
Aug 17 16:29:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:26 user nova-compute[72724]: INFO nova.compute.manager [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] instance snapshotting
Aug 17 16:29:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Beginning live snapshot process
Aug 17 16:29:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json -f qcow2" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6upmpcmp/9016562f9f174efbb2ca4db92f7fd77a.delta 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6upmpcmp/9016562f9f174efbb2ca4db92f7fd77a.delta 1073741824" returned: 0 in 0.051s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 16:29:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:29:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:29:28 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 16:29:28 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:29:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6upmpcmp/9016562f9f174efbb2ca4db92f7fd77a.delta /opt/stack/data/nova/instances/snapshots/tmp6upmpcmp/9016562f9f174efbb2ca4db92f7fd77a {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6upmpcmp/9016562f9f174efbb2ca4db92f7fd77a.delta /opt/stack/data/nova/instances/snapshots/tmp6upmpcmp/9016562f9f174efbb2ca4db92f7fd77a" returned: 0 in 0.527s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Snapshot extracted, beginning image upload
Aug 17 16:29:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:29 user nova-compute[72724]: INFO nova.compute.manager [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Terminating instance
Aug 17 16:29:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-e4d8c876-3ff5-4f71-b784-e70de77ff046 req-286c0569-c9d0-42d3-b268-da3b20a0bd16 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-vif-unplugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e4d8c876-3ff5-4f71-b784-e70de77ff046 req-286c0569-c9d0-42d3-b268-da3b20a0bd16 service nova] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e4d8c876-3ff5-4f71-b784-e70de77ff046 req-286c0569-c9d0-42d3-b268-da3b20a0bd16 service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e4d8c876-3ff5-4f71-b784-e70de77ff046 req-286c0569-c9d0-42d3-b268-da3b20a0bd16 service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-e4d8c876-3ff5-4f71-b784-e70de77ff046 req-286c0569-c9d0-42d3-b268-da3b20a0bd16 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] No waiting events found dispatching network-vif-unplugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-e4d8c876-3ff5-4f71-b784-e70de77ff046 req-286c0569-c9d0-42d3-b268-da3b20a0bd16 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-vif-unplugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:29:30 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Instance destroyed successfully.
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.objects.instance [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lazy-loading 'resources' on Instance uuid 6d53a869-a011-47cc-ae06-9f499036bcc7 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:25:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1472458338',display_name='tempest-TestVolumeSwap-server-1472458338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1472458338',id=12,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFou61sZJpy2xjt9YI2s8qLSUYUi4fWtullLssbKbPuJxuVo4ZVDSl7neDNiDjpeDcc9B9XXwVuSxveUrViocMZVFtsEqh+Qr0xQlSAVwdFb4CKgZC7qicvN2tl9I5luPg==',key_name='tempest-keypair-54243302',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:26:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='140ed8b03f1c405f893dea0fce1855a6',ramdisk_id='',reservation_id='r-sdistu53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2026026569',owner_user_name='tempest-TestVolumeSwap-2026026569-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d2156bdcb9f4e259b40ee4827796598',uuid=6d53a869-a011-47cc-ae06-9f499036bcc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Converting VIF {"id": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "address": "fa:16:3e:c7:65:9f", "network": {"id": "a8e06ce4-c8a2-49ff-acad-abc60fb46b1f", "bridge": "br-int", "label": "tempest-TestVolumeSwap-318420923-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.119", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "140ed8b03f1c405f893dea0fce1855a6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a5b3c7d-02", "ovs_interfaceid": "9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG os_vif [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a5b3c7d-02, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:29:30 user nova-compute[72724]: INFO os_vif [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c7:65:9f,bridge_name='br-int',has_traffic_filtering=True,id=9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce,network=Network(a8e06ce4-c8a2-49ff-acad-abc60fb46b1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a5b3c7d-02')
Aug 17 16:29:30 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Deleting instance files /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7_del
Aug 17 16:29:30 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Deletion of /opt/stack/data/nova/instances/6d53a869-a011-47cc-ae06-9f499036bcc7_del complete
Aug 17 16:29:30 user nova-compute[72724]: INFO nova.compute.manager [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 16:29:30 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:29:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:31 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:29:31 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Took 1.12 seconds to deallocate network for instance.
Aug 17 16:29:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] Acquiring lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] No waiting events found dispatching network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:29:32 user nova-compute[72724]: WARNING nova.compute.manager [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received unexpected event network-vif-plugged-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce for instance with vm_state deleted and task_state None.
Aug 17 16:29:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d08c5afa-7342-455e-a65b-f6310a33eaed req-4b5cd4e7-95e0-45d9-a990-3b822710a234 service nova] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Received event network-vif-deleted-9a5b3c7d-02e3-4de6-bcb8-6348c7b0a7ce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Snapshot image upload complete
Aug 17 16:29:32 user nova-compute[72724]: INFO nova.compute.manager [None req-1911513d-f201-4395-9e6a-c2ed105fe3b2 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Took 5.98 seconds to snapshot the instance on the hypervisor.
Aug 17 16:29:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.912s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.556s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:32 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:29:32 user nova-compute[72724]: INFO nova.compute.claims [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Claim successful on node user
Aug 17 16:29:32 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Deleted allocations for instance 6d53a869-a011-47cc-ae06-9f499036bcc7
Aug 17 16:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-21785088-a779-49b6-9b14-a74f5eca2701 tempest-TestVolumeSwap-2026026569 tempest-TestVolumeSwap-2026026569-project-member] Lock "6d53a869-a011-47cc-ae06-9f499036bcc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.153s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:29:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:29:33 user nova-compute[72724]: INFO nova.virt.block_device [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Booting with volume f14a02a1-0a3d-4b12-8c18-f3937a439820 at /dev/vda
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.policy [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11c91fd3d13a48d7b299488ab320ce2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901d2a4375044098bb152fde8698dfe5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG os_brick.utils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7313f8-5d79-4d8b-8d22-80112a72f700]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb532fee-8f22-4fa9-a15c-6c52f4f4ac2f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f92481-2268-402b-87a4-94d7d541171f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d1b4ba-3495-4218-8b29-250337036e8f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:29:33 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:29:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c508caf2-d991-43b0-a8fc-2be22d8b04f6]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG os_brick.utils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:29:33 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updating existing volume attachment record: 64436e71-a94b-4029-b2eb-fba23f38088c {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Successfully created port: 09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Successfully updated port: 09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquired lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-changed-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Refreshing instance network info cache due to event network-changed-09b43135-e018-4125-a820-19789671d5b9. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] Acquiring lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:29:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updating instance_info_cache with network_info: [{"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Releasing lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance network_info: |[{"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] Acquired lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.network.neutron [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Refreshing network info cache for port 09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.network.neutron [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updated VIF entry in instance network info cache for port 09b43135-e018-4125-a820-19789671d5b9. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.network.neutron [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updating instance_info_cache with network_info: [{"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb68042e-7765-4bb2-846a-0544c0ab24dc req-94b6a37a-8f14-4070-8faa-1720cb6cfb26 service nova] Releasing lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updating instance_info_cache with network_info: [{"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:35 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:39 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:29:39 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=25.643917083740234GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 35b4fcf8-40f6-48b4-a785-c14a86027233 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 83f9af1c-ac8e-4164-8099-59b353263047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 194a5ac4-9157-49c2-beeb-86698432abb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13399825-a90e-47f5-9bb2-925cba27bff2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:29:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:29:40 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:29:40 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:29:40 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:29:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:29:43 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Creating image(s)
Aug 17 16:29:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Ensure instance console log exists: /opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Start _get_guest_xml network_info=[{"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '64436e71-a94b-4029-b2eb-fba23f38088c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13399825-a90e-47f5-9bb2-925cba27bff2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f14a02a1-0a3d-4b12-8c18-f3937a439820', 'serial': 'f14a02a1-0a3d-4b12-8c18-f3937a439820'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:29:44 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:29:44 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:29:44 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:29:44 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:29:44 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4d2c20-65da-41e2-a291-6c5925acfd49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:29:44 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73496bf-d2d3-4a7e-9635-8b52b4138f51]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820] added
Aug 17 16:29:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c69698-337c-412c-b38f-913efd7209cd]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19ac93c-2fd9-4f09-b573-0804eb689f1a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baPRlsmy {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baPRlsmy" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[510d40eb-a31b-43ef-a234-94ba1ab246da]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'baPRlsmy'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[abda4808-1d9a-480e-9fca-761327c9830f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d295f1d-d161-47ad-b343-99dc27cc01c7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:29:44 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:29:44 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:29:44 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 16:29:44 user nova-compute[72724]: 
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1280a8ee-08af-4437-84e0-496b913e07e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]
Aug 17 16:29:44 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.
Aug 17 16:29:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c9d7b-8cbc-4d10-883e-b3a896ce23cb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91d2e4e-2e21-453e-9da8-5e6cff83c3f2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:29:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:29:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac76f54-1246-4967-8ff7-46c48ce6f038]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:29:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26530333035656531', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530333035656531', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-317110015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-317110015',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvByM9UX/8Vi26Q+yKbGDVBwc5mNimk3Dy4Ux+JPhRuokT0dC9DNT4SryLFdLBhKeKjIz7xsEhbXUxzo7jReG6+1JD4yno55EzcuSlj0pcymi0STVXaiytWojf87+GIew==',key_name='tempest-keypair-1145346431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='901d2a4375044098bb152fde8698dfe5',ramdisk_id='',reservation_id='r-hipkov7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1362885906',owner_user_name='tempest-ServerActionsV293TestJSON-1362885906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:29:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c91fd3d13a48d7b299488ab320ce2c',uuid=13399825-a90e-47f5-9bb2-925cba27bff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converting VIF {"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.objects.instance [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'pci_devices' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:29:45 user nova-compute[72724]:   <uuid>13399825-a90e-47f5-9bb2-925cba27bff2</uuid>
Aug 17 16:29:45 user nova-compute[72724]:   <name>instance-00000014</name>
Aug 17 16:29:45 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:29:45 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:29:45 user nova-compute[72724]:   <metadata>
Aug 17 16:29:45 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:29:45 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:29:45 user nova-compute[72724]:       <nova:name>tempest-ServerActionsV293TestJSON-server-317110015</nova:name>
Aug 17 16:29:45 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:29:44</nova:creationTime>
Aug 17 16:29:45 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:29:45 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:29:45 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:29:45 user nova-compute[72724]:       <nova:owner>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:user uuid="11c91fd3d13a48d7b299488ab320ce2c">tempest-ServerActionsV293TestJSON-1362885906-project-member</nova:user>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:project uuid="901d2a4375044098bb152fde8698dfe5">tempest-ServerActionsV293TestJSON-1362885906</nova:project>
Aug 17 16:29:45 user nova-compute[72724]:       </nova:owner>
Aug 17 16:29:45 user nova-compute[72724]:       <nova:ports>
Aug 17 16:29:45 user nova-compute[72724]:         <nova:port uuid="09b43135-e018-4125-a820-19789671d5b9">
Aug 17 16:29:45 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:29:45 user nova-compute[72724]:         </nova:port>
Aug 17 16:29:45 user nova-compute[72724]:       </nova:ports>
Aug 17 16:29:45 user nova-compute[72724]:     </nova:instance>
Aug 17 16:29:45 user nova-compute[72724]:   </metadata>
Aug 17 16:29:45 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:29:45 user nova-compute[72724]:     <system>
Aug 17 16:29:45 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:29:45 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:29:45 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:29:45 user nova-compute[72724]:       <entry name="serial">13399825-a90e-47f5-9bb2-925cba27bff2</entry>
Aug 17 16:29:45 user nova-compute[72724]:       <entry name="uuid">13399825-a90e-47f5-9bb2-925cba27bff2</entry>
Aug 17 16:29:45 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:29:45 user nova-compute[72724]:     </system>
Aug 17 16:29:45 user nova-compute[72724]:   </sysinfo>
Aug 17 16:29:45 user nova-compute[72724]:   <os>
Aug 17 16:29:45 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:29:45 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:29:45 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:29:45 user nova-compute[72724]:   </os>
Aug 17 16:29:45 user nova-compute[72724]:   <features>
Aug 17 16:29:45 user nova-compute[72724]:     <acpi/>
Aug 17 16:29:45 user nova-compute[72724]:     <apic/>
Aug 17 16:29:45 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:29:45 user nova-compute[72724]:   </features>
Aug 17 16:29:45 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:29:45 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:29:45 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:29:45 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:29:45 user nova-compute[72724]:   </clock>
Aug 17 16:29:45 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:29:45 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:29:45 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:29:45 user nova-compute[72724]:   </cpu>
Aug 17 16:29:45 user nova-compute[72724]:   <devices>
Aug 17 16:29:45 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:29:45 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:29:45 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:29:45 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:29:45 user nova-compute[72724]:       <serial>f14a02a1-0a3d-4b12-8c18-f3937a439820</serial>
Aug 17 16:29:45 user nova-compute[72724]:     </disk>
Aug 17 16:29:45 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:29:45 user nova-compute[72724]:       <mac address="fa:16:3e:30:c1:55"/>
Aug 17 16:29:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:29:45 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:29:45 user nova-compute[72724]:       <target dev="tap09b43135-e0"/>
Aug 17 16:29:45 user nova-compute[72724]:     </interface>
Aug 17 16:29:45 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:29:45 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2/console.log" append="off"/>
Aug 17 16:29:45 user nova-compute[72724]:     </serial>
Aug 17 16:29:45 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:29:45 user nova-compute[72724]:     <video>
Aug 17 16:29:45 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:29:45 user nova-compute[72724]:     </video>
Aug 17 16:29:45 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:29:45 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:29:45 user nova-compute[72724]:     </rng>
Aug 17 16:29:45 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:29:45 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:29:45 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:29:45 user nova-compute[72724]:     </memballoon>
Aug 17 16:29:45 user nova-compute[72724]:   </devices>
Aug 17 16:29:45 user nova-compute[72724]: </domain>
Aug 17 16:29:45 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-317110015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-317110015',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvByM9UX/8Vi26Q+yKbGDVBwc5mNimk3Dy4Ux+JPhRuokT0dC9DNT4SryLFdLBhKeKjIz7xsEhbXUxzo7jReG6+1JD4yno55EzcuSlj0pcymi0STVXaiytWojf87+GIew==',key_name='tempest-keypair-1145346431',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='901d2a4375044098bb152fde8698dfe5',ramdisk_id='',reservation_id='r-hipkov7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1362885906',owner_user_name='tempest-ServerActionsV293TestJSON-1362885906-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:29:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c91fd3d13a48d7b299488ab320ce2c',uuid=13399825-a90e-47f5-9bb2-925cba27bff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converting VIF {"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG os_vif [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09b43135-e0, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09b43135-e0, col_values=(('external_ids', {'iface-id': '09b43135-e018-4125-a820-19789671d5b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c1:55', 'vm-uuid': '13399825-a90e-47f5-9bb2-925cba27bff2'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:45 user nova-compute[72724]: INFO os_vif [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0')
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] No VIF found with MAC fa:16:3e:30:c1:55, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289770.4845598, 6d53a869-a011-47cc-ae06-9f499036bcc7 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:29:45 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] VM Stopped (Lifecycle Event)
Aug 17 16:29:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8a294c2e-4a12-4b4e-88d7-905b61b189e6 None None] [instance: 6d53a869-a011-47cc-ae06-9f499036bcc7] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-cd9791e0-97d7-4519-b0f9-086c21129853 req-7d218c61-7535-4e40-b2ec-49e4f16f35ea service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cd9791e0-97d7-4519-b0f9-086c21129853 req-7d218c61-7535-4e40-b2ec-49e4f16f35ea service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cd9791e0-97d7-4519-b0f9-086c21129853 req-7d218c61-7535-4e40-b2ec-49e4f16f35ea service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cd9791e0-97d7-4519-b0f9-086c21129853 req-7d218c61-7535-4e40-b2ec-49e4f16f35ea service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-cd9791e0-97d7-4519-b0f9-086c21129853 req-7d218c61-7535-4e40-b2ec-49e4f16f35ea service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:29:47 user nova-compute[72724]: WARNING nova.compute.manager [req-cd9791e0-97d7-4519-b0f9-086c21129853 req-7d218c61-7535-4e40-b2ec-49e4f16f35ea service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state building and task_state spawning.
Aug 17 16:29:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289788.852263, 13399825-a90e-47f5-9bb2-925cba27bff2 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:29:48 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] VM Resumed (Lifecycle Event)
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:29:48 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance spawned successfully.
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:29:48 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289788.8558903, 13399825-a90e-47f5-9bb2-925cba27bff2 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:29:48 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] VM Started (Lifecycle Event)
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:29:48 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:29:48 user nova-compute[72724]: INFO nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Took 4.98 seconds to spawn the instance on the hypervisor.
Aug 17 16:29:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:29:49 user nova-compute[72724]: INFO nova.compute.manager [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Took 16.88 seconds to build instance.
Aug 17 16:29:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6317275f-4775-4d89-911c-7fe38d6ca2f4 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.201s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-c72983c4-dd61-44d8-9275-9784e8433687 req-c5573c0a-16c9-4370-8730-4e0347a074c5 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:29:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c72983c4-dd61-44d8-9275-9784e8433687 req-c5573c0a-16c9-4370-8730-4e0347a074c5 service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:29:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c72983c4-dd61-44d8-9275-9784e8433687 req-c5573c0a-16c9-4370-8730-4e0347a074c5 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:29:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c72983c4-dd61-44d8-9275-9784e8433687 req-c5573c0a-16c9-4370-8730-4e0347a074c5 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:29:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-c72983c4-dd61-44d8-9275-9784e8433687 req-c5573c0a-16c9-4370-8730-4e0347a074c5 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:29:49 user nova-compute[72724]: WARNING nova.compute.manager [req-c72983c4-dd61-44d8-9275-9784e8433687 req-c5573c0a-16c9-4370-8730-4e0347a074c5 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state active and task_state None.
Aug 17 16:29:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:29:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:30:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:30:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:30:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:30:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:05 user nova-compute[72724]: INFO nova.compute.manager [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Terminating instance
Aug 17 16:30:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-430cbdf3-a14b-49b7-b5e8-f25c37d56e9f req-d255fadb-2df2-4ff8-836e-10d7e70a1b3b service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-vif-unplugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-430cbdf3-a14b-49b7-b5e8-f25c37d56e9f req-d255fadb-2df2-4ff8-836e-10d7e70a1b3b service nova] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-430cbdf3-a14b-49b7-b5e8-f25c37d56e9f req-d255fadb-2df2-4ff8-836e-10d7e70a1b3b service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-430cbdf3-a14b-49b7-b5e8-f25c37d56e9f req-d255fadb-2df2-4ff8-836e-10d7e70a1b3b service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-430cbdf3-a14b-49b7-b5e8-f25c37d56e9f req-d255fadb-2df2-4ff8-836e-10d7e70a1b3b service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] No waiting events found dispatching network-vif-unplugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-430cbdf3-a14b-49b7-b5e8-f25c37d56e9f req-d255fadb-2df2-4ff8-836e-10d7e70a1b3b service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-vif-unplugged-08933904-896d-4a51-9df9-e7e9d168cd65 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Instance destroyed successfully.
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.objects.instance [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lazy-loading 'resources' on Instance uuid 35b4fcf8-40f6-48b4-a785-c14a86027233 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:28:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-997294747',display_name='tempest-ServersNegativeTestJSON-server-997294747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-997294747',id=17,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:28:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fa57b31426d46ad8fa5351fe3ebb91e',ramdisk_id='',reservation_id='r-026hj5s5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-566124124',owner_user_name='tempest-ServersNegativeTestJSON-566124124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:28:23Z,user_data=None,user_id='df91a9dc8e5b49f3bf2188ab3a96b1e8',uuid=35b4fcf8-40f6-48b4-a785-c14a86027233,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converting VIF {"id": "08933904-896d-4a51-9df9-e7e9d168cd65", "address": "fa:16:3e:0c:3c:19", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08933904-89", "ovs_interfaceid": "08933904-896d-4a51-9df9-e7e9d168cd65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG os_vif [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08933904-89, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:30:06 user nova-compute[72724]: INFO os_vif [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:3c:19,bridge_name='br-int',has_traffic_filtering=True,id=08933904-896d-4a51-9df9-e7e9d168cd65,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08933904-89')
Aug 17 16:30:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Deleting instance files /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233_del
Aug 17 16:30:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Deletion of /opt/stack/data/nova/instances/35b4fcf8-40f6-48b4-a785-c14a86027233_del complete
Aug 17 16:30:06 user nova-compute[72724]: INFO nova.compute.manager [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 16:30:06 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:30:06 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:30:07 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:30:07 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Took 0.57 seconds to deallocate network for instance.
Aug 17 16:30:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:07 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:30:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:30:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.285s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:07 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Deleted allocations for instance 35b4fcf8-40f6-48b4-a785-c14a86027233
Aug 17 16:30:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6e3daffb-f73e-4ef8-83f9-d5ae9b84e869 tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.898s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] Acquiring lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] Lock "35b4fcf8-40f6-48b4-a785-c14a86027233-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] No waiting events found dispatching network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:30:08 user nova-compute[72724]: WARNING nova.compute.manager [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received unexpected event network-vif-plugged-08933904-896d-4a51-9df9-e7e9d168cd65 for instance with vm_state deleted and task_state None.
Aug 17 16:30:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-68b3f221-a2fe-4412-b292-490335f69728 req-b4e6bc3f-024f-4e0e-afd5-cf884c736cbb service nova] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Received event network-vif-deleted-08933904-896d-4a51-9df9-e7e9d168cd65 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:21 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289806.6929803, 35b4fcf8-40f6-48b4-a785-c14a86027233 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:30:21 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] VM Stopped (Lifecycle Event)
Aug 17 16:30:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-9c7f89c6-b88e-428b-89c8-3fa08e79aaa5 None None] [instance: 35b4fcf8-40f6-48b4-a785-c14a86027233] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:30:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:30:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:30:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:30:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:30:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-changed-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Refreshing instance network info cache due to event network-changed-1380c6c7-265d-4064-9302-6c037bb6684c. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:30:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] Acquiring lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:30:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] Acquired lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:30:30 user nova-compute[72724]: DEBUG nova.network.neutron [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Refreshing network info cache for port 1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updated VIF entry in instance network info cache for port 1380c6c7-265d-4064-9302-6c037bb6684c. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updating instance_info_cache with network_info: [{"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cb3bc48e-4032-495e-83ae-dba48ab7a582 req-bb08f294-16af-4660-b962-748f2bd2e12b service nova] Releasing lock "refresh_cache-83f9af1c-ac8e-4164-8099-59b353263047" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'flavor' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:31 user nova-compute[72724]: INFO nova.compute.manager [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attaching volume c0846b81-a46e-4232-a4d2-8c2d2399af8f to /dev/vdb
Aug 17 16:30:32 user nova-compute[72724]: DEBUG os_brick.utils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45dfe2b0-846f-469e-a4d9-29b212efa542]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5931b9-8368-43dd-8ba7-a9b6469ac35d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b5db3f-9153-4a99-97b2-4398843cf43f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb40266-9d18-450f-b0dc-288386f70a3b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:30:32 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:30:32 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0196f794-ed4c-45c1-ab49-ed2c0a3543ac]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG os_brick.utils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:32 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updating existing volume attachment record: 8125180a-e19c-4480-a999-af95f3794d54 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:30:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "00db2a89-a70b-461d-a887-ccba383edce6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:30:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:30:34 user nova-compute[72724]: INFO nova.compute.claims [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Claim successful on node user
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:30:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:30:35 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:30:35 user nova-compute[72724]: INFO nova.virt.block_device [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Booting with blank volume at /dev/vda
Aug 17 16:30:35 user nova-compute[72724]: DEBUG nova.policy [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c4b6bc314a140e0a5f12ecfbb43450f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2796590bb0c43479a3e82c1c4c836b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:30:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Successfully created port: c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:30:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Successfully updated port: c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-changed-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Refreshing instance network info cache due to event network-changed-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] Acquiring lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance network_info: |[{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] Acquired lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:30:37 user nova-compute[72724]: DEBUG nova.network.neutron [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Refreshing network info cache for port c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:30:38 user nova-compute[72724]: DEBUG nova.network.neutron [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updated VIF entry in instance network info cache for port c9fc55f1-b4a3-440b-ba17-6f355d32a6e3. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:30:38 user nova-compute[72724]: DEBUG nova.network.neutron [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:30:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5850bc63-a4af-451f-9f55-97e9d4495dc4 req-02553d2b-268a-4bc4-ba4c-d4d658432129 service nova] Releasing lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:30:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd93e4c-eac9-44e2-8a04-92ec64bf7baf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e106b9e5-cdd3-4774-96ae-020b9043f4b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0eade08-514d-495f-afa2-d7fff3f0988f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[43d0eb3f-e72c-427e-9bbf-7ab46695a455]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:30:41 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d43093-8660-4991-a60c-30b3e20c4794]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG os_brick.utils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating existing volume attachment record: de61e002-0090-4fc8-a248-d505355f648b {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:44 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:30:44 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:30:44 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef1a827-2d23-4634-ab87-f28e956632bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:30:44 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ed8be5-8eb2-4f6d-b61c-9bfd23c3c038]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f] added
Aug 17 16:30:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46fb96c-68ab-4a7d-909d-b42eb8a7c10b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[823957c6-73c2-43db-9619-ba17b1173537]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muHLvOES {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muHLvOES" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2c2b0d-8a78-4c3b-9ac2-ff98ab3130b6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muHLvOES'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c98306-ac23-41bc-bd38-b4b092c6428d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feaecfb-a65e-40e2-ae15-7543bd162893]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:44 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:45 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:30:45 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7676MB free_disk=25.65668487548828GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 83f9af1c-ac8e-4164-8099-59b353263047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 194a5ac4-9157-49c2-beeb-86698432abb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13399825-a90e-47f5-9bb2-925cba27bff2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --login" returned: 0 in 1.060s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[17658952-d8b7-4acd-b1b4-36ba9f49c90e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]
Aug 17 16:30:45 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.
Aug 17 16:30:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c28fe0-0d0e-42e0-876f-4661ccce7dd4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba12d8e-2d75-4d0b-ab2e-10b567697cc7]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:45 user nova-compute[72724]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:30:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:45 user nova-compute[72724]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:30:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.335s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87714b0-5f81-48ff-8f08-7fc00178a70b]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:30:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.371s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== connect_volume: return (2373ms) {'type': 'block', 'scsi_wwn': '23136613835663430', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136613835663430', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'flavor' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:30:46 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:30:46 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 16:30:46 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:30:46 user nova-compute[72724]:   <serial>c0846b81-a46e-4232-a4d2-8c2d2399af8f</serial>
Aug 17 16:30:46 user nova-compute[72724]: </disk>
Aug 17 16:30:46 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:30:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:30:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:30:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No VIF found with MAC fa:16:3e:58:aa:15, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:30:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b79a8441-ce9c-486d-91c6-6cb65264083e tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.341s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:49 user nova-compute[72724]: INFO nova.compute.manager [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Rebuilding instance
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_requests' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_devices' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'resources' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'migration_context' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72724) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-7eecb35c-8f30-4283-ab8e-cda430ac255a req-069fd2a0-8a2b-4ba7-9db3-efaf87de68bc service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-unplugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7eecb35c-8f30-4283-ab8e-cda430ac255a req-069fd2a0-8a2b-4ba7-9db3-efaf87de68bc service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7eecb35c-8f30-4283-ab8e-cda430ac255a req-069fd2a0-8a2b-4ba7-9db3-efaf87de68bc service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7eecb35c-8f30-4283-ab8e-cda430ac255a req-069fd2a0-8a2b-4ba7-9db3-efaf87de68bc service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-7eecb35c-8f30-4283-ab8e-cda430ac255a req-069fd2a0-8a2b-4ba7-9db3-efaf87de68bc service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-unplugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:30:49 user nova-compute[72724]: WARNING nova.compute.manager [req-7eecb35c-8f30-4283-ab8e-cda430ac255a req-069fd2a0-8a2b-4ba7-9db3-efaf87de68bc service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-unplugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state active and task_state rebuilding.
Aug 17 16:30:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance destroyed successfully.
Aug 17 16:30:50 user nova-compute[72724]: INFO nova.compute.manager [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Detaching volume c0846b81-a46e-4232-a4d2-8c2d2399af8f
Aug 17 16:30:50 user nova-compute[72724]: INFO nova.virt.block_device [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attempting to driver detach volume c0846b81-a46e-4232-a4d2-8c2d2399af8f from mountpoint /dev/vdb
Aug 17 16:30:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Attempting to detach device vdb from instance 83f9af1c-ac8e-4164-8099-59b353263047 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:30:50 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:30:50 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 16:30:50 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:30:50 user nova-compute[72724]:   <serial>c0846b81-a46e-4232-a4d2-8c2d2399af8f</serial>
Aug 17 16:30:50 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:30:50 user nova-compute[72724]: </disk>
Aug 17 16:30:50 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:30:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully detached device vdb from instance 83f9af1c-ac8e-4164-8099-59b353263047 from the persistent domain config.
Aug 17 16:30:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee26fc5d-8bf6-4849-953f-db0a26bbb9ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea337705-2164-4d6a-9ea8-671a4731be11]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:50 user nova-compute[72724]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:30:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:50 user nova-compute[72724]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:30:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c84132e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[802681af-bec3-4c7c-bd70-53e5cbd24a4b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e906199-4110-4996-9bdb-68edddd90d4f]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[37096150-db4b-4fcd-be19-34aea0a77416]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[760568e7-d29f-4c78-ad3f-4dd25d08c0c0]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[33178bff-9cc9-4720-83df-9c581d1019dc]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6751e9aa-1d70-43da-b379-13486260b97e]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]
Aug 17 16:30:51 user nova-compute[72724]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.
Aug 17 16:30:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f829022-39b1-47d0-a62a-d00ab81342f9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== disconnect_volume: return (321ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance destroyed successfully.
Aug 17 16:30:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1821486414',display_name='tempest-ServerActionsTestOtherA-server-96438778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1821486414',id=18,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHXLwwxkDku5rfnP8iYXTIEqll3oksBJas5Od/7/rp7seEVlxZtrleII/0owGqphwukPIlWXazaavg1ZJNT2OUGOxT7wuEMTgxdn/HAhS2rlB0gZ41Sp66cQeSkkAHL9A==',key_name='tempest-keypair-1823955780',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-0gnojs1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:30:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=83f9af1c-ac8e-4164-8099-59b353263047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1380c6c7-26, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:30:51 user nova-compute[72724]: INFO os_vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26')
Aug 17 16:30:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:51 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c15219d-7c7f-4ad6-9264-93e466c69dc5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9d4eef1-5ddb-4f47-8fbd-e7882ce7656a req-dd5f0e9d-c65d-452a-b416-e6bf26a0d1ce service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9d4eef1-5ddb-4f47-8fbd-e7882ce7656a req-dd5f0e9d-c65d-452a-b416-e6bf26a0d1ce service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9d4eef1-5ddb-4f47-8fbd-e7882ce7656a req-dd5f0e9d-c65d-452a-b416-e6bf26a0d1ce service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9d4eef1-5ddb-4f47-8fbd-e7882ce7656a req-dd5f0e9d-c65d-452a-b416-e6bf26a0d1ce service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9d4eef1-5ddb-4f47-8fbd-e7882ce7656a req-dd5f0e9d-c65d-452a-b416-e6bf26a0d1ce service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:30:52 user nova-compute[72724]: WARNING nova.compute.manager [req-e9d4eef1-5ddb-4f47-8fbd-e7882ce7656a req-dd5f0e9d-c65d-452a-b416-e6bf26a0d1ce service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state active and task_state rebuilding.
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a8892-d8b0-40c2-8791-26aa6b729cf5]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e027df30>, {}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Disconnecting from: [] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== disconnect_volume: return (63ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:30:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Deleting instance files /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047_del
Aug 17 16:30:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Deletion of /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047_del complete
Aug 17 16:30:52 user nova-compute[72724]: INFO nova.virt.block_device [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Booting with volume c0846b81-a46e-4232-a4d2-8c2d2399af8f at /dev/vdb
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.utils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d016ec4-103b-460d-87be-bf32540cd1c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a688a182-4f04-4a32-96ad-615b71b459b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a31a9-abe8-455e-ab99-29c86433b6b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[459f4e9d-54a0-4202-ae22-7eab9c1f1a33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:30:52 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:30:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f96b0fe-b104-4fbd-b5f1-1593ad050820]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG os_brick.utils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:52 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updating existing volume attachment record: 15e7754c-b779-487e-81c4-9a9c059856af {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:30:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Creating image(s)
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Ensure instance console log exists: /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Start _get_guest_xml network_info=[{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'de61e002-0090-4fc8-a248-d505355f648b', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00db2a89-a70b-461d-a887-ccba383edce6', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd34f121-b812-4905-accc-e750f539f8a0', 'serial': 'dd34f121-b812-4905-accc-e750f539f8a0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:30:56 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:30:56 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:30:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:30:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:30:56 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80d2607-ba51-48f5-80d2-3de0669b25df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:30:56 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb00a65-e437-4f76-860c-488c16d4cc77]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0] added
Aug 17 16:30:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d220c25-744c-4aa1-b06f-a7f9a0b36a61]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de65e1-e5cb-4634-916d-30867b60f5f8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEvpKgFh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEvpKgFh" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa2c903-443d-448f-82f2-7b623db5e7ef]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEvpKgFh'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c46dfb-d138-45f6-a640-b9cf407db260]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbf9f35-6efd-40d1-9bdf-b0b6043c5d21]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[575c1b36-6d6c-4d6c-932c-a42259998151]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260]
Aug 17 16:30:56 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260] successful.
Aug 17 16:30:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6837abe-21db-4520-82cd-ce8a5d606231]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8005d1-c401-410f-a5ab-1090631cb307]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:56 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:30:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:30:56 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:30:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3305b6d3-ac14-47a2-9aab-5a9d6f311c58]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:30:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23136633032323764', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136633032323764', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896005839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896005839',id=21,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-62umgiej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:30:35Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=00db2a89-a70b-461d-a887-ccba383edce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'pci_devices' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:30:57 user nova-compute[72724]:   <uuid>00db2a89-a70b-461d-a887-ccba383edce6</uuid>
Aug 17 16:30:57 user nova-compute[72724]:   <name>instance-00000015</name>
Aug 17 16:30:57 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:30:57 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:30:57 user nova-compute[72724]:   <metadata>
Aug 17 16:30:57 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:30:57 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:30:57 user nova-compute[72724]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1896005839</nova:name>
Aug 17 16:30:57 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:30:56</nova:creationTime>
Aug 17 16:30:57 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:30:57 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:30:57 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:30:57 user nova-compute[72724]:       <nova:owner>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:user uuid="9c4b6bc314a140e0a5f12ecfbb43450f">tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member</nova:user>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:project uuid="d2796590bb0c43479a3e82c1c4c836b0">tempest-ServerBootFromVolumeStableRescueTest-1911010508</nova:project>
Aug 17 16:30:57 user nova-compute[72724]:       </nova:owner>
Aug 17 16:30:57 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:30:57 user nova-compute[72724]:       <nova:ports>
Aug 17 16:30:57 user nova-compute[72724]:         <nova:port uuid="c9fc55f1-b4a3-440b-ba17-6f355d32a6e3">
Aug 17 16:30:57 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 16:30:57 user nova-compute[72724]:         </nova:port>
Aug 17 16:30:57 user nova-compute[72724]:       </nova:ports>
Aug 17 16:30:57 user nova-compute[72724]:     </nova:instance>
Aug 17 16:30:57 user nova-compute[72724]:   </metadata>
Aug 17 16:30:57 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:30:57 user nova-compute[72724]:     <system>
Aug 17 16:30:57 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:30:57 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:30:57 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:30:57 user nova-compute[72724]:       <entry name="serial">00db2a89-a70b-461d-a887-ccba383edce6</entry>
Aug 17 16:30:57 user nova-compute[72724]:       <entry name="uuid">00db2a89-a70b-461d-a887-ccba383edce6</entry>
Aug 17 16:30:57 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:30:57 user nova-compute[72724]:     </system>
Aug 17 16:30:57 user nova-compute[72724]:   </sysinfo>
Aug 17 16:30:57 user nova-compute[72724]:   <os>
Aug 17 16:30:57 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:30:57 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:30:57 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:30:57 user nova-compute[72724]:   </os>
Aug 17 16:30:57 user nova-compute[72724]:   <features>
Aug 17 16:30:57 user nova-compute[72724]:     <acpi/>
Aug 17 16:30:57 user nova-compute[72724]:     <apic/>
Aug 17 16:30:57 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:30:57 user nova-compute[72724]:   </features>
Aug 17 16:30:57 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:30:57 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:30:57 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:30:57 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:30:57 user nova-compute[72724]:   </clock>
Aug 17 16:30:57 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:30:57 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:30:57 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:30:57 user nova-compute[72724]:   </cpu>
Aug 17 16:30:57 user nova-compute[72724]:   <devices>
Aug 17 16:30:57 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:30:57 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:30:57 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 16:30:57 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:30:57 user nova-compute[72724]:       <serial>dd34f121-b812-4905-accc-e750f539f8a0</serial>
Aug 17 16:30:57 user nova-compute[72724]:     </disk>
Aug 17 16:30:57 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:30:57 user nova-compute[72724]:       <mac address="fa:16:3e:13:fa:22"/>
Aug 17 16:30:57 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:30:57 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:30:57 user nova-compute[72724]:       <target dev="tapc9fc55f1-b4"/>
Aug 17 16:30:57 user nova-compute[72724]:     </interface>
Aug 17 16:30:57 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:30:57 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/console.log" append="off"/>
Aug 17 16:30:57 user nova-compute[72724]:     </serial>
Aug 17 16:30:57 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:30:57 user nova-compute[72724]:     <video>
Aug 17 16:30:57 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:30:57 user nova-compute[72724]:     </video>
Aug 17 16:30:57 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:30:57 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:30:57 user nova-compute[72724]:     </rng>
Aug 17 16:30:57 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:30:57 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:30:57 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:30:57 user nova-compute[72724]:     </memballoon>
Aug 17 16:30:57 user nova-compute[72724]:   </devices>
Aug 17 16:30:57 user nova-compute[72724]: </domain>
Aug 17 16:30:57 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896005839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896005839',id=21,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-62umgiej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:30:35Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=00db2a89-a70b-461d-a887-ccba383edce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG os_vif [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9fc55f1-b4, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9fc55f1-b4, col_values=(('external_ids', {'iface-id': 'c9fc55f1-b4a3-440b-ba17-6f355d32a6e3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:fa:22', 'vm-uuid': '00db2a89-a70b-461d-a887-ccba383edce6'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:30:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:58 user nova-compute[72724]: INFO os_vif [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4')
Aug 17 16:30:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:30:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No VIF found with MAC fa:16:3e:13:fa:22, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-4d789bef-1e59-4f30-9340-66efb3e8a737 req-ee234d80-c4b6-4070-b12d-551c01cd28e2 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4d789bef-1e59-4f30-9340-66efb3e8a737 req-ee234d80-c4b6-4070-b12d-551c01cd28e2 service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4d789bef-1e59-4f30-9340-66efb3e8a737 req-ee234d80-c4b6-4070-b12d-551c01cd28e2 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4d789bef-1e59-4f30-9340-66efb3e8a737 req-ee234d80-c4b6-4070-b12d-551c01cd28e2 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:30:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-4d789bef-1e59-4f30-9340-66efb3e8a737 req-ee234d80-c4b6-4070-b12d-551c01cd28e2 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:30:59 user nova-compute[72724]: WARNING nova.compute.manager [req-4d789bef-1e59-4f30-9340-66efb3e8a737 req-ee234d80-c4b6-4070-b12d-551c01cd28e2 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state building and task_state spawning.
Aug 17 16:31:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-1f7644f4-e711-4062-a564-4ab4b9751f95 req-180c9818-d150-4707-b05a-d3136572c7bd service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1f7644f4-e711-4062-a564-4ab4b9751f95 req-180c9818-d150-4707-b05a-d3136572c7bd service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1f7644f4-e711-4062-a564-4ab4b9751f95 req-180c9818-d150-4707-b05a-d3136572c7bd service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1f7644f4-e711-4062-a564-4ab4b9751f95 req-180c9818-d150-4707-b05a-d3136572c7bd service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-1f7644f4-e711-4062-a564-4ab4b9751f95 req-180c9818-d150-4707-b05a-d3136572c7bd service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:01 user nova-compute[72724]: WARNING nova.compute.manager [req-1f7644f4-e711-4062-a564-4ab4b9751f95 req-180c9818-d150-4707-b05a-d3136572c7bd service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state building and task_state spawning.
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289861.833445, 00db2a89-a70b-461d-a887-ccba383edce6 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:01 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Resumed (Lifecycle Event)
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:31:01 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance spawned successfully.
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:01 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289861.8381934, 00db2a89-a70b-461d-a887-ccba383edce6 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:01 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Started (Lifecycle Event)
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:01 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:31:01 user nova-compute[72724]: INFO nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Took 5.46 seconds to spawn the instance on the hypervisor.
Aug 17 16:31:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:02 user nova-compute[72724]: INFO nova.compute.manager [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Took 27.52 seconds to build instance.
Aug 17 16:31:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-369eed25-ab83-40ab-aacc-df4a8ee965b7 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "00db2a89-a70b-461d-a887-ccba383edce6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.636s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing instance network info cache due to event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:31:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:02 user nova-compute[72724]: DEBUG nova.network.neutron [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:31:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:03 user nova-compute[72724]: DEBUG nova.network.neutron [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updated VIF entry in instance network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:31:03 user nova-compute[72724]: DEBUG nova.network.neutron [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4702d715-ce9f-4334-bd76-962ae25caa64 req-3672025b-61ec-4078-8ecf-b60b6c8f9f4e service nova] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:31:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Creating image(s)
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk 1073741824" returned: 0 in 0.056s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.221s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289850.3598218, 83f9af1c-ac8e-4164-8099-59b353263047 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:05 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] VM Stopped (Lifecycle Event)
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6948a4ce-f712-495a-b114-979f05e598a2 None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Cannot resize image /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Ensure instance console log exists: /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Start _get_guest_xml network_info=[{"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '15e7754c-b779-487e-81c4-9a9c059856af', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '83f9af1c-ac8e-4164-8099-59b353263047', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0846b81-a46e-4232-a4d2-8c2d2399af8f', 'serial': 'c0846b81-a46e-4232-a4d2-8c2d2399af8f'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:31:05 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 16:31:05 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:31:05 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:31:05 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:31:05 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[052549c3-4361-4e9e-804c-1ccfa2ef9cd0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:31:05 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bdd516-4c4a-4805-81e5-1a5d32a0804f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f] added
Aug 17 16:31:05 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2456dc54-4773-40ef-acb6-d9f1d71965aa]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2f48f41-7e0f-41ed-b4c0-794e715aef24]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muHLvOES {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v muHLvOES" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac08c78-89da-4706-9531-c4fb82f87d78]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'muHLvOES'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c957aa-60c8-4e1e-89c6-4cb80f921c3e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e24352-0608-4377-871a-95382485f43b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[771362b8-8429-42f8-a5a0-bc8ab7ec8b09]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]
Aug 17 16:31:05 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.
Aug 17 16:31:05 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c9feae-4783-43fa-b605-b6b9659341a9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5501ddd7-33ef-4877-928f-43a3cd798295]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:31:05 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:05 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:31:05 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b9287-678c-488f-8c48-794c9109b76b]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:31:05 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23136613835663430', 'path': '/dev/sdd'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136613835663430', 'path': '/dev/sdd'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1821486414',display_name='tempest-ServerActionsTestOtherA-server-96438778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1821486414',id=18,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHXLwwxkDku5rfnP8iYXTIEqll3oksBJas5Od/7/rp7seEVlxZtrleII/0owGqphwukPIlWXazaavg1ZJNT2OUGOxT7wuEMTgxdn/HAhS2rlB0gZ41Sp66cQeSkkAHL9A==',key_name='tempest-keypair-1823955780',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-0gnojs1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=83f9af1c-ac8e-4164-8099-59b353263047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:31:06 user nova-compute[72724]:   <uuid>83f9af1c-ac8e-4164-8099-59b353263047</uuid>
Aug 17 16:31:06 user nova-compute[72724]:   <name>instance-00000012</name>
Aug 17 16:31:06 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:31:06 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:31:06 user nova-compute[72724]:   <metadata>
Aug 17 16:31:06 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:31:06 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:31:06 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherA-server-96438778</nova:name>
Aug 17 16:31:06 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:31:05</nova:creationTime>
Aug 17 16:31:06 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:31:06 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:31:06 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:31:06 user nova-compute[72724]:       <nova:owner>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:user uuid="d44441d94d244ec5a0e0b00617a3229f">tempest-ServerActionsTestOtherA-2020786536-project-member</nova:user>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:project uuid="6f4518061f274934833bc6801498ec91">tempest-ServerActionsTestOtherA-2020786536</nova:project>
Aug 17 16:31:06 user nova-compute[72724]:       </nova:owner>
Aug 17 16:31:06 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:31:06 user nova-compute[72724]:       <nova:ports>
Aug 17 16:31:06 user nova-compute[72724]:         <nova:port uuid="1380c6c7-265d-4064-9302-6c037bb6684c">
Aug 17 16:31:06 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:31:06 user nova-compute[72724]:         </nova:port>
Aug 17 16:31:06 user nova-compute[72724]:       </nova:ports>
Aug 17 16:31:06 user nova-compute[72724]:     </nova:instance>
Aug 17 16:31:06 user nova-compute[72724]:   </metadata>
Aug 17 16:31:06 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:31:06 user nova-compute[72724]:     <system>
Aug 17 16:31:06 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:31:06 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:31:06 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:31:06 user nova-compute[72724]:       <entry name="serial">83f9af1c-ac8e-4164-8099-59b353263047</entry>
Aug 17 16:31:06 user nova-compute[72724]:       <entry name="uuid">83f9af1c-ac8e-4164-8099-59b353263047</entry>
Aug 17 16:31:06 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:31:06 user nova-compute[72724]:     </system>
Aug 17 16:31:06 user nova-compute[72724]:   </sysinfo>
Aug 17 16:31:06 user nova-compute[72724]:   <os>
Aug 17 16:31:06 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:31:06 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:31:06 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:31:06 user nova-compute[72724]:   </os>
Aug 17 16:31:06 user nova-compute[72724]:   <features>
Aug 17 16:31:06 user nova-compute[72724]:     <acpi/>
Aug 17 16:31:06 user nova-compute[72724]:     <apic/>
Aug 17 16:31:06 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:31:06 user nova-compute[72724]:   </features>
Aug 17 16:31:06 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:31:06 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:31:06 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:31:06 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:31:06 user nova-compute[72724]:   </clock>
Aug 17 16:31:06 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:31:06 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:31:06 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:31:06 user nova-compute[72724]:   </cpu>
Aug 17 16:31:06 user nova-compute[72724]:   <devices>
Aug 17 16:31:06 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:31:06 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:31:06 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk"/>
Aug 17 16:31:06 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:31:06 user nova-compute[72724]:     </disk>
Aug 17 16:31:06 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:31:06 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:31:06 user nova-compute[72724]:       <source dev="/dev/sdd"/>
Aug 17 16:31:06 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:31:06 user nova-compute[72724]:       <serial>c0846b81-a46e-4232-a4d2-8c2d2399af8f</serial>
Aug 17 16:31:06 user nova-compute[72724]:     </disk>
Aug 17 16:31:06 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:31:06 user nova-compute[72724]:       <mac address="fa:16:3e:58:aa:15"/>
Aug 17 16:31:06 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:31:06 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:31:06 user nova-compute[72724]:       <target dev="tap1380c6c7-26"/>
Aug 17 16:31:06 user nova-compute[72724]:     </interface>
Aug 17 16:31:06 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:31:06 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/console.log" append="off"/>
Aug 17 16:31:06 user nova-compute[72724]:     </serial>
Aug 17 16:31:06 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:31:06 user nova-compute[72724]:     <video>
Aug 17 16:31:06 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:31:06 user nova-compute[72724]:     </video>
Aug 17 16:31:06 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:31:06 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:31:06 user nova-compute[72724]:     </rng>
Aug 17 16:31:06 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:31:06 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:31:06 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:31:06 user nova-compute[72724]:     </memballoon>
Aug 17 16:31:06 user nova-compute[72724]:   </devices>
Aug 17 16:31:06 user nova-compute[72724]: </domain>
Aug 17 16:31:06 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1821486414',display_name='tempest-ServerActionsTestOtherA-server-96438778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1821486414',id=18,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHXLwwxkDku5rfnP8iYXTIEqll3oksBJas5Od/7/rp7seEVlxZtrleII/0owGqphwukPIlWXazaavg1ZJNT2OUGOxT7wuEMTgxdn/HAhS2rlB0gZ41Sp66cQeSkkAHL9A==',key_name='tempest-keypair-1823955780',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:28:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-0gnojs1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:30:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=83f9af1c-ac8e-4164-8099-59b353263047,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG os_vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1380c6c7-26, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1380c6c7-26, col_values=(('external_ids', {'iface-id': '1380c6c7-265d-4064-9302-6c037bb6684c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:58:aa:15', 'vm-uuid': '83f9af1c-ac8e-4164-8099-59b353263047'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:31:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:07 user nova-compute[72724]: INFO os_vif [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26')
Aug 17 16:31:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:31:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:31:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No VIF found with MAC fa:16:3e:58:aa:15, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-42f52018-87b9-4f41-bfdc-be456732ffd1 req-108f3803-08c8-41a6-ac89-186f67921ae3 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-42f52018-87b9-4f41-bfdc-be456732ffd1 req-108f3803-08c8-41a6-ac89-186f67921ae3 service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-42f52018-87b9-4f41-bfdc-be456732ffd1 req-108f3803-08c8-41a6-ac89-186f67921ae3 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-42f52018-87b9-4f41-bfdc-be456732ffd1 req-108f3803-08c8-41a6-ac89-186f67921ae3 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-42f52018-87b9-4f41-bfdc-be456732ffd1 req-108f3803-08c8-41a6-ac89-186f67921ae3 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:08 user nova-compute[72724]: WARNING nova.compute.manager [req-42f52018-87b9-4f41-bfdc-be456732ffd1 req-108f3803-08c8-41a6-ac89-186f67921ae3 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state active and task_state rebuild_spawning.
Aug 17 16:31:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:09 user nova-compute[72724]: INFO nova.compute.manager [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Shelving
Aug 17 16:31:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance destroyed successfully.
Aug 17 16:31:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Beginning cold snapshot process
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk /opt/stack/data/nova/instances/snapshots/tmpey9zgfk7/69a3b93d7a454988b6a9bde30429d7d1 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk /opt/stack/data/nova/instances/snapshots/tmpey9zgfk7/69a3b93d7a454988b6a9bde30429d7d1" returned: 0 in 0.609s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Snapshot extracted, beginning image upload
Aug 17 16:31:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:10 user nova-compute[72724]: WARNING nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state active and task_state rebuild_spawning.
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-unplugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-unplugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:10 user nova-compute[72724]: WARNING nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-unplugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:10 user nova-compute[72724]: WARNING nova.compute.manager [req-65315d29-3b03-4dc5-ac5c-9adadf24728d req-b7d1c31b-3a6b-49d7-b17e-501550652211 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state active and task_state shelving_image_uploading.
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289871.1399798, 83f9af1c-ac8e-4164-8099-59b353263047 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] VM Resumed (Lifecycle Event)
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:31:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance spawned successfully.
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289871.1415439, 83f9af1c-ac8e-4164-8099-59b353263047 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] VM Started (Lifecycle Event)
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72724) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f108855-5638-450f-a214-218366088d97 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.070s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Snapshot image upload complete
Aug 17 16:31:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:13 user nova-compute[72724]: INFO nova.compute.manager [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Shelve offloading
Aug 17 16:31:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance destroyed successfully.
Aug 17 16:31:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:31:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance destroyed successfully.
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'resources' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-336069617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-336069617',id=19,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5YB99VGoL3C3YdDwPY4qPwMFdUgKGIXY4faMBXjKJkjNyuqAANHxfNjGVk4UBrSA8bu4w1Xlk3KtWBh7CWLLyipmf0SGDC5vy5q6kux/27Jsq/NiqNKuMFHHvasvzFBw==',key_name='tempest-keypair-11081656',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-ok1ep51j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member',shelved_at='2023-08-17T16:31:13.694861',shelved_host='user',shelved_image_id='e5a3b370-c3de-46a0-b099-b9d2ff351626'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=194a5ac4-9157-49c2-beeb-86698432abb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG os_vif [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be4c18a-38, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:31:15 user nova-compute[72724]: INFO os_vif [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38')
Aug 17 16:31:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Deleting instance files /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3_del
Aug 17 16:31:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Deletion of /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3_del complete
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing instance network info cache due to event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.network.neutron [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:31:15 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Deleted allocations for instance 194a5ac4-9157-49c2-beeb-86698432abb3
Aug 17 16:31:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'numa_topology' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:31:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updated VIF entry in instance network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:31:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap3be4c18a-38", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-755f05f3-0739-4212-8992-7f0c68978b98 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.021s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9b7d694-c9d7-4938-a6c5-eb16c37c94d2 req-cb4305eb-2900-46d7-9b50-277790e5b275 service nova] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:31:17 user nova-compute[72724]: INFO nova.compute.claims [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Claim successful on node user
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:31:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:31:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Creating image(s)
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "/opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "/opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG nova.policy [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b60543c2f6042aab2f771a25f69d6df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '42dcfe5ff7a34703a0c5195ec7ca5882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk 1073741824" returned: 0 in 0.050s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Cannot resize image /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lazy-loading 'migration_context' on Instance uuid 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Ensure instance console log exists: /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Successfully created port: 55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Successfully updated port: 55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "refresh_cache-3d935f81-a7d9-416d-9f44-4d1afd2b16b9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquired lock "refresh_cache-3d935f81-a7d9-416d-9f44-4d1afd2b16b9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-changed-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Refreshing instance network info cache due to event network-changed-55e89de7-e83f-4c81-8714-44769e127f95. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] Acquiring lock "refresh_cache-3d935f81-a7d9-416d-9f44-4d1afd2b16b9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Updating instance_info_cache with network_info: [{"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Releasing lock "refresh_cache-3d935f81-a7d9-416d-9f44-4d1afd2b16b9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Instance network_info: |[{"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] Acquired lock "refresh_cache-3d935f81-a7d9-416d-9f44-4d1afd2b16b9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.neutron [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Refreshing network info cache for port 55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Start _get_guest_xml network_info=[{"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:31:20 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:31:20 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-696750255',display_name='tempest-VolumesNegativeTest-instance-696750255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-696750255',id=22,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42dcfe5ff7a34703a0c5195ec7ca5882',ramdisk_id='',reservation_id='r-dn0841u0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2032580775',owner_user_name='tempest-VolumesNegativeTest-2032580775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:31:18Z,user_data=None,user_id='3b60543c2f6042aab2f771a25f69d6df',uuid=3d935f81-a7d9-416d-9f44-4d1afd2b16b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Converting VIF {"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:31:20 user nova-compute[72724]:   <uuid>3d935f81-a7d9-416d-9f44-4d1afd2b16b9</uuid>
Aug 17 16:31:20 user nova-compute[72724]:   <name>instance-00000016</name>
Aug 17 16:31:20 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:31:20 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:31:20 user nova-compute[72724]:   <metadata>
Aug 17 16:31:20 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:31:20 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:31:20 user nova-compute[72724]:       <nova:name>tempest-VolumesNegativeTest-instance-696750255</nova:name>
Aug 17 16:31:20 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:31:20</nova:creationTime>
Aug 17 16:31:20 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:31:20 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:31:20 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:31:20 user nova-compute[72724]:       <nova:owner>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:user uuid="3b60543c2f6042aab2f771a25f69d6df">tempest-VolumesNegativeTest-2032580775-project-member</nova:user>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:project uuid="42dcfe5ff7a34703a0c5195ec7ca5882">tempest-VolumesNegativeTest-2032580775</nova:project>
Aug 17 16:31:20 user nova-compute[72724]:       </nova:owner>
Aug 17 16:31:20 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:31:20 user nova-compute[72724]:       <nova:ports>
Aug 17 16:31:20 user nova-compute[72724]:         <nova:port uuid="55e89de7-e83f-4c81-8714-44769e127f95">
Aug 17 16:31:20 user nova-compute[72724]:           <nova:ip type="fixed" address="192.168.233.153" ipVersion="4"/>
Aug 17 16:31:20 user nova-compute[72724]:         </nova:port>
Aug 17 16:31:20 user nova-compute[72724]:       </nova:ports>
Aug 17 16:31:20 user nova-compute[72724]:     </nova:instance>
Aug 17 16:31:20 user nova-compute[72724]:   </metadata>
Aug 17 16:31:20 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:31:20 user nova-compute[72724]:     <system>
Aug 17 16:31:20 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:31:20 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:31:20 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:31:20 user nova-compute[72724]:       <entry name="serial">3d935f81-a7d9-416d-9f44-4d1afd2b16b9</entry>
Aug 17 16:31:20 user nova-compute[72724]:       <entry name="uuid">3d935f81-a7d9-416d-9f44-4d1afd2b16b9</entry>
Aug 17 16:31:20 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:31:20 user nova-compute[72724]:     </system>
Aug 17 16:31:20 user nova-compute[72724]:   </sysinfo>
Aug 17 16:31:20 user nova-compute[72724]:   <os>
Aug 17 16:31:20 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:31:20 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:31:20 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:31:20 user nova-compute[72724]:   </os>
Aug 17 16:31:20 user nova-compute[72724]:   <features>
Aug 17 16:31:20 user nova-compute[72724]:     <acpi/>
Aug 17 16:31:20 user nova-compute[72724]:     <apic/>
Aug 17 16:31:20 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:31:20 user nova-compute[72724]:   </features>
Aug 17 16:31:20 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:31:20 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:31:20 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:31:20 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:31:20 user nova-compute[72724]:   </clock>
Aug 17 16:31:20 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:31:20 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:31:20 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:31:20 user nova-compute[72724]:   </cpu>
Aug 17 16:31:20 user nova-compute[72724]:   <devices>
Aug 17 16:31:20 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:31:20 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:31:20 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk"/>
Aug 17 16:31:20 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:31:20 user nova-compute[72724]:     </disk>
Aug 17 16:31:20 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:31:20 user nova-compute[72724]:       <mac address="fa:16:3e:7c:bf:16"/>
Aug 17 16:31:20 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:31:20 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:31:20 user nova-compute[72724]:       <target dev="tap55e89de7-e8"/>
Aug 17 16:31:20 user nova-compute[72724]:     </interface>
Aug 17 16:31:20 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:31:20 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/console.log" append="off"/>
Aug 17 16:31:20 user nova-compute[72724]:     </serial>
Aug 17 16:31:20 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:31:20 user nova-compute[72724]:     <video>
Aug 17 16:31:20 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:31:20 user nova-compute[72724]:     </video>
Aug 17 16:31:20 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:31:20 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:31:20 user nova-compute[72724]:     </rng>
Aug 17 16:31:20 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:31:20 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:31:20 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:31:20 user nova-compute[72724]:     </memballoon>
Aug 17 16:31:20 user nova-compute[72724]:   </devices>
Aug 17 16:31:20 user nova-compute[72724]: </domain>
Aug 17 16:31:20 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-696750255',display_name='tempest-VolumesNegativeTest-instance-696750255',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-696750255',id=22,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='42dcfe5ff7a34703a0c5195ec7ca5882',ramdisk_id='',reservation_id='r-dn0841u0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-2032580775',owner_user_name='tempest-VolumesNegativeTest-2032580775-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:31:18Z,user_data=None,user_id='3b60543c2f6042aab2f771a25f69d6df',uuid=3d935f81-a7d9-416d-9f44-4d1afd2b16b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Converting VIF {"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG os_vif [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55e89de7-e8, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap55e89de7-e8, col_values=(('external_ids', {'iface-id': '55e89de7-e83f-4c81-8714-44769e127f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:bf:16', 'vm-uuid': '3d935f81-a7d9-416d-9f44-4d1afd2b16b9'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:20 user nova-compute[72724]: INFO os_vif [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8')
Aug 17 16:31:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:31:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] No VIF found with MAC fa:16:3e:7c:bf:16, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:31:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Updated VIF entry in instance network info cache for port 55e89de7-e83f-4c81-8714-44769e127f95. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:31:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Updating instance_info_cache with network_info: [{"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d4792e94-5f32-464e-b2ca-a4cb56cdd1bf req-da14fa5c-f09c-48ae-b259-a84fc76205e1 service nova] Releasing lock "refresh_cache-3d935f81-a7d9-416d-9f44-4d1afd2b16b9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-77dca7aa-83c3-4a30-b99f-4bdbd68dc339 req-62939e91-63d2-4e68-9e00-1f3ef3f1eae5 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-77dca7aa-83c3-4a30-b99f-4bdbd68dc339 req-62939e91-63d2-4e68-9e00-1f3ef3f1eae5 service nova] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-77dca7aa-83c3-4a30-b99f-4bdbd68dc339 req-62939e91-63d2-4e68-9e00-1f3ef3f1eae5 service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-77dca7aa-83c3-4a30-b99f-4bdbd68dc339 req-62939e91-63d2-4e68-9e00-1f3ef3f1eae5 service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-77dca7aa-83c3-4a30-b99f-4bdbd68dc339 req-62939e91-63d2-4e68-9e00-1f3ef3f1eae5 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] No waiting events found dispatching network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:22 user nova-compute[72724]: WARNING nova.compute.manager [req-77dca7aa-83c3-4a30-b99f-4bdbd68dc339 req-62939e91-63d2-4e68-9e00-1f3ef3f1eae5 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received unexpected event network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 for instance with vm_state building and task_state spawning.
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289884.6895168, 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] VM Resumed (Lifecycle Event)
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Instance spawned successfully.
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Rebuilding instance
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289884.694387, 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] VM Started (Lifecycle Event)
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'trusted_certs' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Took 6.95 seconds to spawn the instance on the hypervisor.
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289869.8533397, 194a5ac4-9157-49c2-beeb-86698432abb3 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] VM Stopped (Lifecycle Event)
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b57b555f-5ce2-48ee-a146-28d2ea5b5c38 None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-changed-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Refreshing instance network info cache due to event network-changed-09b43135-e018-4125-a820-19789671d5b9. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] Acquiring lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] Acquired lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.network.neutron [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Refreshing network info cache for port 09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'pci_requests' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:24 user nova-compute[72724]: INFO nova.compute.manager [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Took 7.73 seconds to build instance.
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'pci_devices' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69e64f23-a02a-4c8e-9ffd-a582e7b1320b tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.856s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'resources' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'migration_context' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72724) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-e8048c8c-b2f0-43d5-bda3-604efc00dd52 req-e98b6605-173f-44bf-a93e-fd721016df69 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-unplugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e8048c8c-b2f0-43d5-bda3-604efc00dd52 req-e98b6605-173f-44bf-a93e-fd721016df69 service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e8048c8c-b2f0-43d5-bda3-604efc00dd52 req-e98b6605-173f-44bf-a93e-fd721016df69 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e8048c8c-b2f0-43d5-bda3-604efc00dd52 req-e98b6605-173f-44bf-a93e-fd721016df69 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-e8048c8c-b2f0-43d5-bda3-604efc00dd52 req-e98b6605-173f-44bf-a93e-fd721016df69 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-unplugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:25 user nova-compute[72724]: WARNING nova.compute.manager [req-e8048c8c-b2f0-43d5-bda3-604efc00dd52 req-e98b6605-173f-44bf-a93e-fd721016df69 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-unplugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state active and task_state rebuilding.
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance destroyed successfully.
Aug 17 16:31:25 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance destroyed successfully.
Aug 17 16:31:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2097568250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-317110015',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvByM9UX/8Vi26Q+yKbGDVBwc5mNimk3Dy4Ux+JPhRuokT0dC9DNT4SryLFdLBhKeKjIz7xsEhbXUxzo7jReG6+1JD4yno55EzcuSlj0pcymi0STVXaiytWojf87+GIew==',key_name='tempest-keypair-1145346431',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='901d2a4375044098bb152fde8698dfe5',ramdisk_id='',reservation_id='r-hipkov7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1362885906',owner_user_name='tempest-ServerActionsV293TestJSON-1362885906-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:31:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c91fd3d13a48d7b299488ab320ce2c',uuid=13399825-a90e-47f5-9bb2-925cba27bff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converting VIF {"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09b43135-e0, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:31:25 user nova-compute[72724]: INFO os_vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0')
Aug 17 16:31:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:31:25 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c435cecd-88dd-480a-b570-19cacbd70cd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99a2457-9615-47a4-beae-68df31dd615d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:31:25 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:25 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:31:25 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:31:25 user nova-compute[72724]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:25 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:31:25 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81bcd30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b21d0e-d863-4e27-b1ea-f6d02bf03b3b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec7c355-a14c-403a-b758-2eae98351468]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.107s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6209f9f2-809c-4719-8e3e-bcc1aecbcfc6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c651ab2-7008-48d2-9826-63f15baa42a6]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26530333035656531', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2f020d26', '/dev/disk/by-id/scsi-1SCST_BIO2f020d26-e0305ee13f6f73c5') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 16:31:26 user nova-compute[72724]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26530333035656531
Aug 17 16:31:26 user nova-compute[72724]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2f020d26
Aug 17 16:31:26 user nova-compute[72724]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2f020d26-e0305ee13f6f73c5
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee270da0-e098-453a-a0e1-87a2f87c8436]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e51b22-b469-4d9f-8d7b-4365c1936344]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updated VIF entry in instance network info cache for port 09b43135-e018-4125-a820-19789671d5b9. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updating instance_info_cache with network_info: [{"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] Releasing lock "refresh_cache-13399825-a90e-47f5-9bb2-925cba27bff2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] No waiting events found dispatching network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:26 user nova-compute[72724]: WARNING nova.compute.manager [req-a00455a5-1b77-4181-9cc7-210df1c46e58 req-e89cf7a2-c0ab-414f-ba72-187f07ed97c1 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received unexpected event network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 for instance with vm_state building and task_state spawning.
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bb8f5d-5f94-4374-bce6-c255a1255b58]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]
Aug 17 16:31:26 user nova-compute[72724]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.
Aug 17 16:31:26 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5a72a2-30c6-4fa2-85fa-9f61a4494541]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== disconnect_volume: return (452ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:31:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Deleting instance files /opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2_del
Aug 17 16:31:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Deletion of /opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2_del complete
Aug 17 16:31:26 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 13399825-a90e-47f5-9bb2-925cba27bff2 could not be found.
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:31:26 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b98448-be8c-4235-829a-c337043d6e8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b982a8a9-c286-4ad6-997b-0220aab1679f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:26 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:31:26 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:31:26 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:31:26 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e02492d0>, {}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Disconnecting from: [] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.062s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== disconnect_volume: return (63ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:31:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-1441e265-fc7b-4399-8602-7f4ed4d8a755 req-5511a0e3-7a07-41b0-a4b4-6390090bbfb1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1441e265-fc7b-4399-8602-7f4ed4d8a755 req-5511a0e3-7a07-41b0-a4b4-6390090bbfb1 service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1441e265-fc7b-4399-8602-7f4ed4d8a755 req-5511a0e3-7a07-41b0-a4b4-6390090bbfb1 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1441e265-fc7b-4399-8602-7f4ed4d8a755 req-5511a0e3-7a07-41b0-a4b4-6390090bbfb1 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-1441e265-fc7b-4399-8602-7f4ed4d8a755 req-5511a0e3-7a07-41b0-a4b4-6390090bbfb1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:27 user nova-compute[72724]: WARNING nova.compute.manager [req-1441e265-fc7b-4399-8602-7f4ed4d8a755 req-5511a0e3-7a07-41b0-a4b4-6390090bbfb1 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state active and task_state rebuilding.
Aug 17 16:31:27 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Preparing to wait for external event volume-reimaged-f14a02a1-0a3d-4b12-8c18-f3937a439820 {{(pid=72724) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:27 user nova-compute[72724]: INFO nova.compute.manager [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Rescuing
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:27 user nova-compute[72724]: DEBUG nova.network.neutron [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-cac760be-7d1b-4958-a44c-a4112bb1e19f req-3578c144-c1e5-48fb-9ad0-da791679bbd5 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cac760be-7d1b-4958-a44c-a4112bb1e19f req-3578c144-c1e5-48fb-9ad0-da791679bbd5 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cac760be-7d1b-4958-a44c-a4112bb1e19f req-3578c144-c1e5-48fb-9ad0-da791679bbd5 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cac760be-7d1b-4958-a44c-a4112bb1e19f req-3578c144-c1e5-48fb-9ad0-da791679bbd5 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-cac760be-7d1b-4958-a44c-a4112bb1e19f req-3578c144-c1e5-48fb-9ad0-da791679bbd5 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:28 user nova-compute[72724]: WARNING nova.compute.manager [req-cac760be-7d1b-4958-a44c-a4112bb1e19f req-3578c144-c1e5-48fb-9ad0-da791679bbd5 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state active and task_state rescuing.
Aug 17 16:31:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance destroyed successfully.
Aug 17 16:31:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Attempting rescue
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72724) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:31:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Creating image(s)
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'trusted_certs' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.239s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue" returned: 0 in 0.069s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'migration_context' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Start _get_guest_xml network_info=[{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:03:95:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'resources' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'numa_topology' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:31:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'vcpu_model' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-697311111',display_name='tempest-ServerRescueNegativeTestJSON-server-697311111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-697311111',id=14,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:26:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-rytohmqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:26:50Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=f09067a8-3cf3-4fe7-aa75-78348da59adb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:03:95:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:03:95:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'pci_devices' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:31:29 user nova-compute[72724]:   <uuid>f09067a8-3cf3-4fe7-aa75-78348da59adb</uuid>
Aug 17 16:31:29 user nova-compute[72724]:   <name>instance-0000000e</name>
Aug 17 16:31:29 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:31:29 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:31:29 user nova-compute[72724]:   <metadata>
Aug 17 16:31:29 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:31:29 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:31:29 user nova-compute[72724]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-697311111</nova:name>
Aug 17 16:31:29 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:31:29</nova:creationTime>
Aug 17 16:31:29 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:31:29 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:31:29 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:31:29 user nova-compute[72724]:       <nova:owner>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:user uuid="558eaa9f170b40978f6004f1e6aff3e9">tempest-ServerRescueNegativeTestJSON-2097085369-project-member</nova:user>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:project uuid="c4767040317048ddb4479fa7c82f3384">tempest-ServerRescueNegativeTestJSON-2097085369</nova:project>
Aug 17 16:31:29 user nova-compute[72724]:       </nova:owner>
Aug 17 16:31:29 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:31:29 user nova-compute[72724]:       <nova:ports>
Aug 17 16:31:29 user nova-compute[72724]:         <nova:port uuid="dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9">
Aug 17 16:31:29 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:31:29 user nova-compute[72724]:         </nova:port>
Aug 17 16:31:29 user nova-compute[72724]:       </nova:ports>
Aug 17 16:31:29 user nova-compute[72724]:     </nova:instance>
Aug 17 16:31:29 user nova-compute[72724]:   </metadata>
Aug 17 16:31:29 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:31:29 user nova-compute[72724]:     <system>
Aug 17 16:31:29 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:31:29 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:31:29 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:31:29 user nova-compute[72724]:       <entry name="serial">f09067a8-3cf3-4fe7-aa75-78348da59adb</entry>
Aug 17 16:31:29 user nova-compute[72724]:       <entry name="uuid">f09067a8-3cf3-4fe7-aa75-78348da59adb</entry>
Aug 17 16:31:29 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:31:29 user nova-compute[72724]:     </system>
Aug 17 16:31:29 user nova-compute[72724]:   </sysinfo>
Aug 17 16:31:29 user nova-compute[72724]:   <os>
Aug 17 16:31:29 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:31:29 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:31:29 user nova-compute[72724]:   </os>
Aug 17 16:31:29 user nova-compute[72724]:   <features>
Aug 17 16:31:29 user nova-compute[72724]:     <acpi/>
Aug 17 16:31:29 user nova-compute[72724]:     <apic/>
Aug 17 16:31:29 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:31:29 user nova-compute[72724]:   </features>
Aug 17 16:31:29 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:31:29 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:31:29 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:31:29 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:31:29 user nova-compute[72724]:   </clock>
Aug 17 16:31:29 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:31:29 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:31:29 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:31:29 user nova-compute[72724]:   </cpu>
Aug 17 16:31:29 user nova-compute[72724]:   <devices>
Aug 17 16:31:29 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:31:29 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:31:29 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue"/>
Aug 17 16:31:29 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:31:29 user nova-compute[72724]:     </disk>
Aug 17 16:31:29 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:31:29 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:31:29 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk"/>
Aug 17 16:31:29 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:31:29 user nova-compute[72724]:     </disk>
Aug 17 16:31:29 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:31:29 user nova-compute[72724]:       <mac address="fa:16:3e:03:95:21"/>
Aug 17 16:31:29 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:31:29 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:31:29 user nova-compute[72724]:       <target dev="tapdbac9e36-0f"/>
Aug 17 16:31:29 user nova-compute[72724]:     </interface>
Aug 17 16:31:29 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:31:29 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/console.log" append="off"/>
Aug 17 16:31:29 user nova-compute[72724]:     </serial>
Aug 17 16:31:29 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:31:29 user nova-compute[72724]:     <video>
Aug 17 16:31:29 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:31:29 user nova-compute[72724]:     </video>
Aug 17 16:31:29 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:31:29 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:31:29 user nova-compute[72724]:     </rng>
Aug 17 16:31:29 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:31:29 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:31:29 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:31:29 user nova-compute[72724]:     </memballoon>
Aug 17 16:31:29 user nova-compute[72724]:   </devices>
Aug 17 16:31:29 user nova-compute[72724]: </domain>
Aug 17 16:31:29 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:31:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance destroyed successfully.
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:31:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:03:95:21, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:31:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-3939931a-061e-4995-97a7-7bcff3fd7634 req-425a78d7-192d-4cc2-a590-fd68fb4d50e6 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3939931a-061e-4995-97a7-7bcff3fd7634 req-425a78d7-192d-4cc2-a590-fd68fb4d50e6 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3939931a-061e-4995-97a7-7bcff3fd7634 req-425a78d7-192d-4cc2-a590-fd68fb4d50e6 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3939931a-061e-4995-97a7-7bcff3fd7634 req-425a78d7-192d-4cc2-a590-fd68fb4d50e6 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-3939931a-061e-4995-97a7-7bcff3fd7634 req-425a78d7-192d-4cc2-a590-fd68fb4d50e6 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:30 user nova-compute[72724]: WARNING nova.compute.manager [req-3939931a-061e-4995-97a7-7bcff3fd7634 req-425a78d7-192d-4cc2-a590-fd68fb4d50e6 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state active and task_state rescuing.
Aug 17 16:31:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:32 user nova-compute[72724]: WARNING nova.compute.manager [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state active and task_state rescuing.
Aug 17 16:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:31:32 user nova-compute[72724]: WARNING nova.compute.manager [req-d7722760-d88a-4c79-87bc-203ecb4570b4 req-14418317-1f3c-41e7-bdb2-401222fcbed9 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state active and task_state rescuing.
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for f09067a8-3cf3-4fe7-aa75-78348da59adb due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289893.7324612, f09067a8-3cf3-4fe7-aa75-78348da59adb => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:33 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Resumed (Lifecycle Event)
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-51e66ea4-ff7b-45b6-a2ab-59c13c0c4a20 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:33 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289893.73934, f09067a8-3cf3-4fe7-aa75-78348da59adb => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:33 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Started (Lifecycle Event)
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:31:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:31:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:31:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289885.7978523, 13399825-a90e-47f5-9bb2-925cba27bff2 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:31:40 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] VM Stopped (Lifecycle Event)
Aug 17 16:31:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-580946ad-0c2d-4297-96b1-bafe607f2b77 None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:31:42 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:31:42 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7812MB free_disk=25.611618041992188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 83f9af1c-ac8e-4164-8099-59b353263047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13399825-a90e-47f5-9bb2-925cba27bff2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:31:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:31:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:31:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-cce640b8-418c-469c-a729-8aca7ee0fc39 req-862eade8-bc4c-4877-bb3a-e73cddde147e service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event volume-reimaged-f14a02a1-0a3d-4b12-8c18-f3937a439820 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cce640b8-418c-469c-a729-8aca7ee0fc39 req-862eade8-bc4c-4877-bb3a-e73cddde147e service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cce640b8-418c-469c-a729-8aca7ee0fc39 req-862eade8-bc4c-4877-bb3a-e73cddde147e service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cce640b8-418c-469c-a729-8aca7ee0fc39 req-862eade8-bc4c-4877-bb3a-e73cddde147e service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-cce640b8-418c-469c-a729-8aca7ee0fc39 req-862eade8-bc4c-4877-bb3a-e73cddde147e service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Processing event volume-reimaged-f14a02a1-0a3d-4b12-8c18-f3937a439820 {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:31:49 user nova-compute[72724]: INFO nova.virt.block_device [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Booting with volume f14a02a1-0a3d-4b12-8c18-f3937a439820 at /dev/vda
Aug 17 16:31:49 user nova-compute[72724]: DEBUG os_brick.utils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05adb205-eaf7-4ace-857c-003cbc13b0f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b704e18c-23ca-4648-ac91-bd902fce088c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c2dc0c-83d1-442d-8322-4cb2b3c4b67c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb21e50-1f53-4b65-800e-6cf726b2530c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:31:49 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:31:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc2d53d-545c-446d-adc0-4711a1fd68fa]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG os_brick.utils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:31:49 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updating existing volume attachment record: 56d983a5-4814-45ba-9c22-92fc67021686 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:31:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:31:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:32:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Creating image(s)
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Ensure instance console log exists: /opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Start _get_guest_xml network_info=[{"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '56d983a5-4814-45ba-9c22-92fc67021686', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13399825-a90e-47f5-9bb2-925cba27bff2', 'attached_at': '', 'detached_at': '', 'volume_id': 'f14a02a1-0a3d-4b12-8c18-f3937a439820', 'serial': 'f14a02a1-0a3d-4b12-8c18-f3937a439820'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:32:00 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 16:32:00 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'vcpu_model' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:32:00 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:32:00 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:32:00 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:32:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca8e6ed-8cef-4097-a41f-c636ba8afcea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:32:00 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b72bf5-5392-44a3-bfd9-e288ca94a1c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820] added
Aug 17 16:32:00 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef15824-c25a-453b-8832-fcbc8adf59cf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[57df5a7a-214c-4415-b14e-8656bc979ead]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baPRlsmy {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v baPRlsmy" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cf5c9a-ea2b-4f76-b016-1b51c006e7c9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'baPRlsmy'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fbcec97-6196-4cdd-a2c6-c4592ed4f5a9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ee62d2-a4e3-4be3-a5b5-3a42cf015ab7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:32:01 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:32:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:32:01 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:32:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16c2362-2253-4fc7-8d57-578853b42687]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]
Aug 17 16:32:01 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.
Aug 17 16:32:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9beb1e-20b1-4830-aab3-8e33d6dc498f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f93f9b-cbd8-49a3-9830-32119ca2d6b6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:32:01 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:32:01 user nova-compute[72724]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:32:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:32:01 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:32:01 user nova-compute[72724]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:32:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[96768cab-adb6-423d-86f5-d8e68e2041b6]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:32:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26530333035656531', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530333035656531', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2097568250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-317110015',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvByM9UX/8Vi26Q+yKbGDVBwc5mNimk3Dy4Ux+JPhRuokT0dC9DNT4SryLFdLBhKeKjIz7xsEhbXUxzo7jReG6+1JD4yno55EzcuSlj0pcymi0STVXaiytWojf87+GIew==',key_name='tempest-keypair-1145346431',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='901d2a4375044098bb152fde8698dfe5',ramdisk_id='',reservation_id='r-hipkov7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1362885906',owner_user_name='tempest-ServerActionsV293TestJSON-1362885906-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c91fd3d13a48d7b299488ab320ce2c',uuid=13399825-a90e-47f5-9bb2-925cba27bff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converting VIF {"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:32:02 user nova-compute[72724]:   <uuid>13399825-a90e-47f5-9bb2-925cba27bff2</uuid>
Aug 17 16:32:02 user nova-compute[72724]:   <name>instance-00000014</name>
Aug 17 16:32:02 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:32:02 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:32:02 user nova-compute[72724]:   <metadata>
Aug 17 16:32:02 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:32:02 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:32:02 user nova-compute[72724]:       <nova:name>tempest-ServerActionsV293TestJSON-server-2097568250</nova:name>
Aug 17 16:32:02 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:32:00</nova:creationTime>
Aug 17 16:32:02 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:32:02 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:32:02 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:32:02 user nova-compute[72724]:       <nova:owner>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:user uuid="11c91fd3d13a48d7b299488ab320ce2c">tempest-ServerActionsV293TestJSON-1362885906-project-member</nova:user>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:project uuid="901d2a4375044098bb152fde8698dfe5">tempest-ServerActionsV293TestJSON-1362885906</nova:project>
Aug 17 16:32:02 user nova-compute[72724]:       </nova:owner>
Aug 17 16:32:02 user nova-compute[72724]:       <nova:ports>
Aug 17 16:32:02 user nova-compute[72724]:         <nova:port uuid="09b43135-e018-4125-a820-19789671d5b9">
Aug 17 16:32:02 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 16:32:02 user nova-compute[72724]:         </nova:port>
Aug 17 16:32:02 user nova-compute[72724]:       </nova:ports>
Aug 17 16:32:02 user nova-compute[72724]:     </nova:instance>
Aug 17 16:32:02 user nova-compute[72724]:   </metadata>
Aug 17 16:32:02 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:32:02 user nova-compute[72724]:     <system>
Aug 17 16:32:02 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:32:02 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:32:02 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:32:02 user nova-compute[72724]:       <entry name="serial">13399825-a90e-47f5-9bb2-925cba27bff2</entry>
Aug 17 16:32:02 user nova-compute[72724]:       <entry name="uuid">13399825-a90e-47f5-9bb2-925cba27bff2</entry>
Aug 17 16:32:02 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:32:02 user nova-compute[72724]:     </system>
Aug 17 16:32:02 user nova-compute[72724]:   </sysinfo>
Aug 17 16:32:02 user nova-compute[72724]:   <os>
Aug 17 16:32:02 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:32:02 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:32:02 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:32:02 user nova-compute[72724]:   </os>
Aug 17 16:32:02 user nova-compute[72724]:   <features>
Aug 17 16:32:02 user nova-compute[72724]:     <acpi/>
Aug 17 16:32:02 user nova-compute[72724]:     <apic/>
Aug 17 16:32:02 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:32:02 user nova-compute[72724]:   </features>
Aug 17 16:32:02 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:32:02 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:32:02 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:32:02 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:32:02 user nova-compute[72724]:   </clock>
Aug 17 16:32:02 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:32:02 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:32:02 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:32:02 user nova-compute[72724]:   </cpu>
Aug 17 16:32:02 user nova-compute[72724]:   <devices>
Aug 17 16:32:02 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:32:02 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:32:02 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:32:02 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:32:02 user nova-compute[72724]:       <serial>f14a02a1-0a3d-4b12-8c18-f3937a439820</serial>
Aug 17 16:32:02 user nova-compute[72724]:     </disk>
Aug 17 16:32:02 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:32:02 user nova-compute[72724]:       <mac address="fa:16:3e:30:c1:55"/>
Aug 17 16:32:02 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:32:02 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:32:02 user nova-compute[72724]:       <target dev="tap09b43135-e0"/>
Aug 17 16:32:02 user nova-compute[72724]:     </interface>
Aug 17 16:32:02 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:32:02 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2/console.log" append="off"/>
Aug 17 16:32:02 user nova-compute[72724]:     </serial>
Aug 17 16:32:02 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:32:02 user nova-compute[72724]:     <video>
Aug 17 16:32:02 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:32:02 user nova-compute[72724]:     </video>
Aug 17 16:32:02 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:32:02 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:32:02 user nova-compute[72724]:     </rng>
Aug 17 16:32:02 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:32:02 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:32:02 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:32:02 user nova-compute[72724]:     </memballoon>
Aug 17 16:32:02 user nova-compute[72724]:   </devices>
Aug 17 16:32:02 user nova-compute[72724]: </domain>
Aug 17 16:32:02 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2097568250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-317110015',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvByM9UX/8Vi26Q+yKbGDVBwc5mNimk3Dy4Ux+JPhRuokT0dC9DNT4SryLFdLBhKeKjIz7xsEhbXUxzo7jReG6+1JD4yno55EzcuSlj0pcymi0STVXaiytWojf87+GIew==',key_name='tempest-keypair-1145346431',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:29:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='901d2a4375044098bb152fde8698dfe5',ramdisk_id='',reservation_id='r-hipkov7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1362885906',owner_user_name='tempest-ServerActionsV293TestJSON-1362885906-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c91fd3d13a48d7b299488ab320ce2c',uuid=13399825-a90e-47f5-9bb2-925cba27bff2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converting VIF {"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG os_vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09b43135-e0, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap09b43135-e0, col_values=(('external_ids', {'iface-id': '09b43135-e018-4125-a820-19789671d5b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:c1:55', 'vm-uuid': '13399825-a90e-47f5-9bb2-925cba27bff2'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:02 user nova-compute[72724]: INFO os_vif [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0')
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:32:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] No VIF found with MAC fa:16:3e:30:c1:55, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-2108ade9-e9a6-4d9e-b087-27e39dda9072 req-7e201ee6-368a-4883-9556-82b0ea3006c3 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2108ade9-e9a6-4d9e-b087-27e39dda9072 req-7e201ee6-368a-4883-9556-82b0ea3006c3 service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2108ade9-e9a6-4d9e-b087-27e39dda9072 req-7e201ee6-368a-4883-9556-82b0ea3006c3 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2108ade9-e9a6-4d9e-b087-27e39dda9072 req-7e201ee6-368a-4883-9556-82b0ea3006c3 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-2108ade9-e9a6-4d9e-b087-27e39dda9072 req-7e201ee6-368a-4883-9556-82b0ea3006c3 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:32:03 user nova-compute[72724]: WARNING nova.compute.manager [req-2108ade9-e9a6-4d9e-b087-27e39dda9072 req-7e201ee6-368a-4883-9556-82b0ea3006c3 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 16:32:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289925.8872805, 13399825-a90e-47f5-9bb2-925cba27bff2 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:32:05 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] VM Resumed (Lifecycle Event)
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:32:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance spawned successfully.
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:05 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289925.8876674, 13399825-a90e-47f5-9bb2-925cba27bff2 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:32:05 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] VM Started (Lifecycle Event)
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:32:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:32:06 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 17 16:32:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-0badd889-844c-4d1d-b1c5-521921bcbb90 req-59819217-1dad-4dd8-94ca-9912e927bc81 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0badd889-844c-4d1d-b1c5-521921bcbb90 req-59819217-1dad-4dd8-94ca-9912e927bc81 service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0badd889-844c-4d1d-b1c5-521921bcbb90 req-59819217-1dad-4dd8-94ca-9912e927bc81 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0badd889-844c-4d1d-b1c5-521921bcbb90 req-59819217-1dad-4dd8-94ca-9912e927bc81 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-0badd889-844c-4d1d-b1c5-521921bcbb90 req-59819217-1dad-4dd8-94ca-9912e927bc81 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:32:06 user nova-compute[72724]: WARNING nova.compute.manager [req-0badd889-844c-4d1d-b1c5-521921bcbb90 req-59819217-1dad-4dd8-94ca-9912e927bc81 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state active and task_state rebuild_spawning.
Aug 17 16:32:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72724) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 17 16:32:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cce640b8-418c-469c-a729-8aca7ee0fc39 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.071s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:25 user nova-compute[72724]: INFO nova.compute.manager [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Rescuing
Aug 17 16:32:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:32:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:32:25 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:32:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-762a54b3-5079-40f4-bc5a-28572310d0b0 req-f2823b7f-781e-4e61-b8ab-169e59f235f2 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-762a54b3-5079-40f4-bc5a-28572310d0b0 req-f2823b7f-781e-4e61-b8ab-169e59f235f2 service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-762a54b3-5079-40f4-bc5a-28572310d0b0 req-f2823b7f-781e-4e61-b8ab-169e59f235f2 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-762a54b3-5079-40f4-bc5a-28572310d0b0 req-f2823b7f-781e-4e61-b8ab-169e59f235f2 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-762a54b3-5079-40f4-bc5a-28572310d0b0 req-f2823b7f-781e-4e61-b8ab-169e59f235f2 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:32:26 user nova-compute[72724]: WARNING nova.compute.manager [req-762a54b3-5079-40f4-bc5a-28572310d0b0 req-f2823b7f-781e-4e61-b8ab-169e59f235f2 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state rescuing.
Aug 17 16:32:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance destroyed successfully.
Aug 17 16:32:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Attempting a stable device rescue
Aug 17 16:32:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72724) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:32:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Creating image(s)
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "/opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'trusted_certs' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.part --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG nova.virt.images [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] fabe5216-bf30-46b2-869b-552de4d44026 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.part /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-8ffe5116-0618-458d-af11-71ce107e34a4 req-48d84ac3-761e-41d2-b94e-40d6a45ab05b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8ffe5116-0618-458d-af11-71ce107e34a4 req-48d84ac3-761e-41d2-b94e-40d6a45ab05b service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8ffe5116-0618-458d-af11-71ce107e34a4 req-48d84ac3-761e-41d2-b94e-40d6a45ab05b service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8ffe5116-0618-458d-af11-71ce107e34a4 req-48d84ac3-761e-41d2-b94e-40d6a45ab05b service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-8ffe5116-0618-458d-af11-71ce107e34a4 req-48d84ac3-761e-41d2-b94e-40d6a45ab05b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:32:28 user nova-compute[72724]: WARNING nova.compute.manager [req-8ffe5116-0618-458d-af11-71ce107e34a4 req-48d84ac3-761e-41d2-b94e-40d6a45ab05b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state rescuing.
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.part /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.converted" returned: 0 in 0.417s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.777s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9 --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9,backing_fmt=raw /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9,backing_fmt=raw /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue" returned: 0 in 0.053s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'migration_context' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Start _get_guest_xml network_info=[{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "vif_mac": "fa:16:3e:13:fa:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'fabe5216-bf30-46b2-869b-552de4d44026', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'de61e002-0090-4fc8-a248-d505355f648b', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '00db2a89-a70b-461d-a887-ccba383edce6', 'attached_at': '', 'detached_at': '', 'volume_id': 'dd34f121-b812-4905-accc-e750f539f8a0', 'serial': 'dd34f121-b812-4905-accc-e750f539f8a0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'resources' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'numa_topology' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:32:29 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'vcpu_model' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:32:29 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:32:29 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:32:29 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c7f88e-cd35-4ee4-93b5-368f6e8c79b2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = aEvpKgFh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 16:32:29 user nova-compute[72724]: node.name = iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0
Aug 17 16:32:29 user nova-compute[72724]: node.tpgt = -1
Aug 17 16:32:29 user nova-compute[72724]: node.startup = automatic
Aug 17 16:32:29 user nova-compute[72724]: node.leading_login = No
Aug 17 16:32:29 user nova-compute[72724]: iface.iscsi_ifacename = default
Aug 17 16:32:29 user nova-compute[72724]: iface.net_ifacename = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.ipaddress = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.prefix_len = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.hwaddress = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.transport_name = tcp
Aug 17 16:32:29 user nova-compute[72724]: iface.initiatorname = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.vlan_id = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.vlan_priority = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.vlan_state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.iface_num = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.mtu = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.port = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.bootproto = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.subnet_mask = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.gateway = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_alt_client_id = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_dns = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_learn_iqn = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_vendor_id_state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_vendor_id = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.dhcp_slp_da = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.fragmentation = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.gratuitous_arp = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.incoming_forwarding = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.tos_state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.tos = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.ttl = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.delayed_ack = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.tcp_nagle = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.tcp_wsf_state = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.tcp_wsf = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.tcp_timer_scale = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.tcp_timestamp = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.redirect = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.def_task_mgmt_timeout = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.header_digest = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.data_digest = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.immediate_data = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.initial_r2t = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.data_seq_inorder = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.data_pdu_inorder = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.erl = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.max_receive_data_len = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.first_burst_len = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.max_outstanding_r2t = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.max_burst_len = 0
Aug 17 16:32:29 user nova-compute[72724]: iface.chap_auth = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.bidi_chap = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.strict_login_compliance = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.discovery_auth = <empty>
Aug 17 16:32:29 user nova-compute[72724]: iface.discovery_logout = <empty>
Aug 17 16:32:29 user nova-compute[72724]: node.discovery_address = <empty>
Aug 17 16:32:29 user nova-compute[72724]: node.discovery_port = 0
Aug 17 16:32:29 user nova-compute[72724]: node.discovery_type = static
Aug 17 16:32:29 user nova-compute[72724]: node.session.initial_cmdsn = 0
Aug 17 16:32:29 user nova-compute[72724]: node.session.initial_login_retry_max = 8
Aug 17 16:32:29 user nova-compute[72724]: node.session.xmit_thread_priority = -20
Aug 17 16:32:29 user nova-compute[72724]: node.session.cmds_max = 128
Aug 17 16:32:29 user nova-compute[72724]: node.session.queue_depth = 32
Aug 17 16:32:29 user nova-compute[72724]: node.session.nr_sessions = 1
Aug 17 16:32:29 user nova-compute[72724]: node.session.auth.authmethod = CHAP
Aug 17 16:32:29 user nova-compute[72724]: node.session.auth.username = aEvpKgFh
Aug 17 16:32:29 user nova-compute[72724]: node.session.auth.password = ***
Aug 17 16:32:29 user nova-compute[72724]: node.session.auth.username_in = <empty>
Aug 17 16:32:29 user nova-compute[72724]: node.session.auth.password_in = <empty>
Aug 17 16:32:29 user nova-compute[72724]: node.session.auth.chap_algs = MD5
Aug 17 16:32:29 user nova-compute[72724]: node.session.timeo.replacement_timeout = 120
Aug 17 16:32:29 user nova-compute[72724]: node.session.err_timeo.abort_timeout = 15
Aug 17 16:32:29 user nova-compute[72724]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 16:32:29 user nova-compute[72724]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 16:32:29 user nova-compute[72724]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.FastAbort = Yes
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.InitialR2T = No
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.ImmediateData = Yes
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.MaxConnections = 1
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 16:32:29 user nova-compute[72724]: node.session.iscsi.ERL = 0
Aug 17 16:32:29 user nova-compute[72724]: node.session.scan = manual
Aug 17 16:32:29 user nova-compute[72724]: node.session.reopen_max = 0
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].address = 172.16.0.220
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].port = 3260
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].startup = manual
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].tcp.window_size = 524288
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].tcp.type_of_service = 0
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].timeo.logout_timeout = 15
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].timeo.login_timeout = 15
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].timeo.auth_timeout = 45
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].iscsi.DataDigest = None
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].iscsi.IFMarker = No
Aug 17 16:32:29 user nova-compute[72724]: node.conn[0].iscsi.OFMarker = No
Aug 17 16:32:29 user nova-compute[72724]: # END RECORD
Aug 17 16:32:29 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb9ca40-699e-4652-bfc6-eb76c3a77003]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1826dd04-597b-4e4d-ba81-6710728956fa]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEvpKgFh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEvpKgFh" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0c4439-f7bd-458a-9e51-3eeafb20055f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEvpKgFh'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dafca4-4b73-4861-a677-3ea2134d5549]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b65f17-d5cb-4a2f-aef2-0c28fc71be2b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:32:29 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:32:29 user nova-compute[72724]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:32:29 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:32:29 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:32:29 user nova-compute[72724]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:32:29 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.157s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] HCTL ('34', '0', '0', 0) found on session 21 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1010fc0e-30e2-4cea-ad96-c860ce4eec0b]: (4, ('0 0 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching for a device in session 21 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.181s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== connect_volume: return (182ms) {'type': 'block', 'scsi_wwn': '23136633032323764', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136633032323764', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896005839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896005839',id=21,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:31:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-62umgiej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:31:02Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=00db2a89-a70b-461d-a887-ccba383edce6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "vif_mac": "fa:16:3e:13:fa:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "vif_mac": "fa:16:3e:13:fa:22"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'pci_devices' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:32:29 user nova-compute[72724]:   <uuid>00db2a89-a70b-461d-a887-ccba383edce6</uuid>
Aug 17 16:32:29 user nova-compute[72724]:   <name>instance-00000015</name>
Aug 17 16:32:29 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:32:29 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:32:29 user nova-compute[72724]:   <metadata>
Aug 17 16:32:29 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:32:29 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:32:29 user nova-compute[72724]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1896005839</nova:name>
Aug 17 16:32:29 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:32:29</nova:creationTime>
Aug 17 16:32:29 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:32:29 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:32:29 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:32:29 user nova-compute[72724]:       <nova:owner>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:user uuid="9c4b6bc314a140e0a5f12ecfbb43450f">tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member</nova:user>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:project uuid="d2796590bb0c43479a3e82c1c4c836b0">tempest-ServerBootFromVolumeStableRescueTest-1911010508</nova:project>
Aug 17 16:32:29 user nova-compute[72724]:       </nova:owner>
Aug 17 16:32:29 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:32:29 user nova-compute[72724]:       <nova:ports>
Aug 17 16:32:29 user nova-compute[72724]:         <nova:port uuid="c9fc55f1-b4a3-440b-ba17-6f355d32a6e3">
Aug 17 16:32:29 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 16:32:29 user nova-compute[72724]:         </nova:port>
Aug 17 16:32:29 user nova-compute[72724]:       </nova:ports>
Aug 17 16:32:29 user nova-compute[72724]:     </nova:instance>
Aug 17 16:32:29 user nova-compute[72724]:   </metadata>
Aug 17 16:32:29 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:32:29 user nova-compute[72724]:     <system>
Aug 17 16:32:29 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:32:29 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:32:29 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:32:29 user nova-compute[72724]:       <entry name="serial">00db2a89-a70b-461d-a887-ccba383edce6</entry>
Aug 17 16:32:29 user nova-compute[72724]:       <entry name="uuid">00db2a89-a70b-461d-a887-ccba383edce6</entry>
Aug 17 16:32:29 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:32:29 user nova-compute[72724]:     </system>
Aug 17 16:32:29 user nova-compute[72724]:   </sysinfo>
Aug 17 16:32:29 user nova-compute[72724]:   <os>
Aug 17 16:32:29 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:32:29 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:32:29 user nova-compute[72724]:   </os>
Aug 17 16:32:29 user nova-compute[72724]:   <features>
Aug 17 16:32:29 user nova-compute[72724]:     <acpi/>
Aug 17 16:32:29 user nova-compute[72724]:     <apic/>
Aug 17 16:32:29 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:32:29 user nova-compute[72724]:   </features>
Aug 17 16:32:29 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:32:29 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:32:29 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:32:29 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:32:29 user nova-compute[72724]:   </clock>
Aug 17 16:32:29 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:32:29 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:32:29 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:32:29 user nova-compute[72724]:   </cpu>
Aug 17 16:32:29 user nova-compute[72724]:   <devices>
Aug 17 16:32:29 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:32:29 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:32:29 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 16:32:29 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:32:29 user nova-compute[72724]:       <serial>dd34f121-b812-4905-accc-e750f539f8a0</serial>
Aug 17 16:32:29 user nova-compute[72724]:     </disk>
Aug 17 16:32:29 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:32:29 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:32:29 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue"/>
Aug 17 16:32:29 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:32:29 user nova-compute[72724]:       <boot order="1"/>
Aug 17 16:32:29 user nova-compute[72724]:     </disk>
Aug 17 16:32:29 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:32:29 user nova-compute[72724]:       <mac address="fa:16:3e:13:fa:22"/>
Aug 17 16:32:29 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:32:29 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:32:29 user nova-compute[72724]:       <target dev="tapc9fc55f1-b4"/>
Aug 17 16:32:29 user nova-compute[72724]:     </interface>
Aug 17 16:32:29 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:32:29 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/console.log" append="off"/>
Aug 17 16:32:29 user nova-compute[72724]:     </serial>
Aug 17 16:32:29 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:32:29 user nova-compute[72724]:     <video>
Aug 17 16:32:29 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:32:29 user nova-compute[72724]:     </video>
Aug 17 16:32:29 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:32:29 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:32:29 user nova-compute[72724]:     </rng>
Aug 17 16:32:29 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:32:29 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:32:29 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:32:29 user nova-compute[72724]:     </memballoon>
Aug 17 16:32:29 user nova-compute[72724]:   </devices>
Aug 17 16:32:29 user nova-compute[72724]: </domain>
Aug 17 16:32:29 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:32:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance destroyed successfully.
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:32:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No VIF found with MAC fa:16:3e:13:fa:22, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-1d78fef9-a5a0-4625-bf57-8c19e503828a req-9dbb0d88-571d-4c63-804a-a92f97a39c8a service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1d78fef9-a5a0-4625-bf57-8c19e503828a req-9dbb0d88-571d-4c63-804a-a92f97a39c8a service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1d78fef9-a5a0-4625-bf57-8c19e503828a req-9dbb0d88-571d-4c63-804a-a92f97a39c8a service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1d78fef9-a5a0-4625-bf57-8c19e503828a req-9dbb0d88-571d-4c63-804a-a92f97a39c8a service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-1d78fef9-a5a0-4625-bf57-8c19e503828a req-9dbb0d88-571d-4c63-804a-a92f97a39c8a service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:32:30 user nova-compute[72724]: WARNING nova.compute.manager [req-1d78fef9-a5a0-4625-bf57-8c19e503828a req-9dbb0d88-571d-4c63-804a-a92f97a39c8a service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state rescuing.
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 00db2a89-a70b-461d-a887-ccba383edce6 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289952.7893214, 00db2a89-a70b-461d-a887-ccba383edce6 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:32:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Resumed (Lifecycle Event)
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1979db32-bab8-4478-90e6-82a90f58b9d9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:32:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289952.7905734, 00db2a89-a70b-461d-a887-ccba383edce6 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:32:32 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Started (Lifecycle Event)
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-62978531-7691-4e39-ae9a-cf3db1470012 req-886b2d77-bc6a-4bf9-86e5-30ca252a2bb1 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-62978531-7691-4e39-ae9a-cf3db1470012 req-886b2d77-bc6a-4bf9-86e5-30ca252a2bb1 service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-62978531-7691-4e39-ae9a-cf3db1470012 req-886b2d77-bc6a-4bf9-86e5-30ca252a2bb1 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-62978531-7691-4e39-ae9a-cf3db1470012 req-886b2d77-bc6a-4bf9-86e5-30ca252a2bb1 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-62978531-7691-4e39-ae9a-cf3db1470012 req-886b2d77-bc6a-4bf9-86e5-30ca252a2bb1 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:32:32 user nova-compute[72724]: WARNING nova.compute.manager [req-62978531-7691-4e39-ae9a-cf3db1470012 req-886b2d77-bc6a-4bf9-86e5-30ca252a2bb1 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state rescued and task_state None.
Aug 17 16:32:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:32:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:32:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:32:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:32:42 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:32:42 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:32:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7868MB free_disk=25.485450744628906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:32:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 83f9af1c-ac8e-4164-8099-59b353263047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13399825-a90e-47f5-9bb2-925cba27bff2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:32:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:32:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:32:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:32:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:01 user nova-compute[72724]: INFO nova.compute.manager [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Unshelving
Aug 17 16:33:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:01 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'pci_requests' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:01 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'numa_topology' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:01 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:33:01 user nova-compute[72724]: INFO nova.compute.claims [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Claim successful on node user
Aug 17 16:33:02 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:33:02 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:33:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:02 user nova-compute[72724]: INFO nova.network.neutron [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating port 3be4c18a-383a-464f-a54e-dde317ef8fb4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing instance network info cache due to event network-changed-3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] Acquiring lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:33:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Creating image(s)
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'trusted_certs' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] Acquired lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG nova.network.neutron [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Refreshing network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "c871232697aa71f8c83f531dc998843db9129fdd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "c871232697aa71f8c83f531dc998843db9129fdd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.part --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG nova.virt.images [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] e5a3b370-c3de-46a0-b099-b9d2ff351626 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.part /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updated VIF entry in instance network info cache for port 3be4c18a-383a-464f-a54e-dde317ef8fb4. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.part /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.converted" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a8098a21-b67f-40d1-94ea-abbee7f15ac8 req-1cdfa8be-48fd-4874-bcd5-9f498b84eb87 service nova] Releasing lock "refresh_cache-194a5ac4-9157-49c2-beeb-86698432abb3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "c871232697aa71f8c83f531dc998843db9129fdd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.498s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "c871232697aa71f8c83f531dc998843db9129fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "c871232697aa71f8c83f531dc998843db9129fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd --force-share --output=json" returned: 0 in 0.167s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd,backing_fmt=raw /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd,backing_fmt=raw /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk 1073741824" returned: 0 in 0.051s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "c871232697aa71f8c83f531dc998843db9129fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'migration_context' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Rebasing disk image.
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.168s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b -F raw /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:07 user nova-compute[72724]: INFO nova.compute.manager [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Terminating instance
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-a86ce828-ff98-46bc-9b8a-fc09e6ebf1e3 req-3a17ef7d-abd3-4ad6-8b25-fed0130d604b service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-vif-unplugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a86ce828-ff98-46bc-9b8a-fc09e6ebf1e3 req-3a17ef7d-abd3-4ad6-8b25-fed0130d604b service nova] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a86ce828-ff98-46bc-9b8a-fc09e6ebf1e3 req-3a17ef7d-abd3-4ad6-8b25-fed0130d604b service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a86ce828-ff98-46bc-9b8a-fc09e6ebf1e3 req-3a17ef7d-abd3-4ad6-8b25-fed0130d604b service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-a86ce828-ff98-46bc-9b8a-fc09e6ebf1e3 req-3a17ef7d-abd3-4ad6-8b25-fed0130d604b service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] No waiting events found dispatching network-vif-unplugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-a86ce828-ff98-46bc-9b8a-fc09e6ebf1e3 req-3a17ef7d-abd3-4ad6-8b25-fed0130d604b service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-vif-unplugged-55e89de7-e83f-4c81-8714-44769e127f95 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:07 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Instance destroyed successfully.
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lazy-loading 'resources' on Instance uuid 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:31:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-696750255',display_name='tempest-VolumesNegativeTest-instance-696750255',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-696750255',id=22,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:31:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='42dcfe5ff7a34703a0c5195ec7ca5882',ramdisk_id='',reservation_id='r-dn0841u0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-2032580775',owner_user_name='tempest-VolumesNegativeTest-2032580775-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:31:25Z,user_data=None,user_id='3b60543c2f6042aab2f771a25f69d6df',uuid=3d935f81-a7d9-416d-9f44-4d1afd2b16b9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Converting VIF {"id": "55e89de7-e83f-4c81-8714-44769e127f95", "address": "fa:16:3e:7c:bf:16", "network": {"id": "ca8a404e-8ca1-4aa4-9974-69a39ee8afa2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.153", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "60a6cd0c01de4c6ea99688dc807b89a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55e89de7-e8", "ovs_interfaceid": "55e89de7-e83f-4c81-8714-44769e127f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG os_vif [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:33:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b -F raw /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk" returned: 0 in 2.057s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Ensure instance console log exists: /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Start _get_guest_xml network_info=[{"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a8d903d344bc7ae5378a72f7f951995c',container_format='bare',created_at=2023-08-17T16:31:09Z,direct_url=<?>,disk_format='qcow2',id=e5a3b370-c3de-46a0-b099-b9d2ff351626,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-336069617-shelved',owner='43b9b4c4d963430e95e8b6fb484c9889',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T16:31:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55e89de7-e8, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:33:08 user nova-compute[72724]: INFO os_vif [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:bf:16,bridge_name='br-int',has_traffic_filtering=True,id=55e89de7-e83f-4c81-8714-44769e127f95,network=Network(ca8a404e-8ca1-4aa4-9974-69a39ee8afa2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55e89de7-e8')
Aug 17 16:33:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Deleting instance files /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9_del
Aug 17 16:33:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Deletion of /opt/stack/data/nova/instances/3d935f81-a7d9-416d-9f44-4d1afd2b16b9_del complete
Aug 17 16:33:08 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:33:08 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a8d903d344bc7ae5378a72f7f951995c',container_format='bare',created_at=2023-08-17T16:31:09Z,direct_url=<?>,disk_format='qcow2',id=e5a3b370-c3de-46a0-b099-b9d2ff351626,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-336069617-shelved',owner='43b9b4c4d963430e95e8b6fb484c9889',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T16:31:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'vcpu_model' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-336069617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-336069617',id=19,image_ref='e5a3b370-c3de-46a0-b099-b9d2ff351626',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-11081656',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-ok1ep51j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member',shelved_at='2023-08-17T16:31:13.694861',shelved_host='user',shelved_image_id='e5a3b370-c3de-46a0-b099-b9d2ff351626'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=194a5ac4-9157-49c2-beeb-86698432abb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'pci_devices' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:08 user nova-compute[72724]: INFO nova.compute.manager [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Took 0.81 seconds to destroy the instance on the hypervisor.
Aug 17 16:33:08 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:33:08 user nova-compute[72724]:   <uuid>194a5ac4-9157-49c2-beeb-86698432abb3</uuid>
Aug 17 16:33:08 user nova-compute[72724]:   <name>instance-00000013</name>
Aug 17 16:33:08 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:33:08 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:33:08 user nova-compute[72724]:   <metadata>
Aug 17 16:33:08 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:33:08 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:33:08 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-336069617</nova:name>
Aug 17 16:33:08 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:33:08</nova:creationTime>
Aug 17 16:33:08 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:33:08 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:33:08 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:33:08 user nova-compute[72724]:       <nova:owner>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:user uuid="8041c5cb8ad64f64b31aab70052e4f02">tempest-AttachVolumeShelveTestJSON-239110034-project-member</nova:user>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:project uuid="43b9b4c4d963430e95e8b6fb484c9889">tempest-AttachVolumeShelveTestJSON-239110034</nova:project>
Aug 17 16:33:08 user nova-compute[72724]:       </nova:owner>
Aug 17 16:33:08 user nova-compute[72724]:       <nova:root type="image" uuid="e5a3b370-c3de-46a0-b099-b9d2ff351626"/>
Aug 17 16:33:08 user nova-compute[72724]:       <nova:ports>
Aug 17 16:33:08 user nova-compute[72724]:         <nova:port uuid="3be4c18a-383a-464f-a54e-dde317ef8fb4">
Aug 17 16:33:08 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 16:33:08 user nova-compute[72724]:         </nova:port>
Aug 17 16:33:08 user nova-compute[72724]:       </nova:ports>
Aug 17 16:33:08 user nova-compute[72724]:     </nova:instance>
Aug 17 16:33:08 user nova-compute[72724]:   </metadata>
Aug 17 16:33:08 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:33:08 user nova-compute[72724]:     <system>
Aug 17 16:33:08 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:33:08 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:33:08 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:33:08 user nova-compute[72724]:       <entry name="serial">194a5ac4-9157-49c2-beeb-86698432abb3</entry>
Aug 17 16:33:08 user nova-compute[72724]:       <entry name="uuid">194a5ac4-9157-49c2-beeb-86698432abb3</entry>
Aug 17 16:33:08 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:33:08 user nova-compute[72724]:     </system>
Aug 17 16:33:08 user nova-compute[72724]:   </sysinfo>
Aug 17 16:33:08 user nova-compute[72724]:   <os>
Aug 17 16:33:08 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:33:08 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:33:08 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:33:08 user nova-compute[72724]:   </os>
Aug 17 16:33:08 user nova-compute[72724]:   <features>
Aug 17 16:33:08 user nova-compute[72724]:     <acpi/>
Aug 17 16:33:08 user nova-compute[72724]:     <apic/>
Aug 17 16:33:08 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:33:08 user nova-compute[72724]:   </features>
Aug 17 16:33:08 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:33:08 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:33:08 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:33:08 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:33:08 user nova-compute[72724]:   </clock>
Aug 17 16:33:08 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:33:08 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:33:08 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:33:08 user nova-compute[72724]:   </cpu>
Aug 17 16:33:08 user nova-compute[72724]:   <devices>
Aug 17 16:33:08 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:33:08 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:33:08 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk"/>
Aug 17 16:33:08 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:33:08 user nova-compute[72724]:     </disk>
Aug 17 16:33:08 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:33:08 user nova-compute[72724]:       <mac address="fa:16:3e:04:93:1d"/>
Aug 17 16:33:08 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:33:08 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:33:08 user nova-compute[72724]:       <target dev="tap3be4c18a-38"/>
Aug 17 16:33:08 user nova-compute[72724]:     </interface>
Aug 17 16:33:08 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:33:08 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/console.log" append="off"/>
Aug 17 16:33:08 user nova-compute[72724]:     </serial>
Aug 17 16:33:08 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:33:08 user nova-compute[72724]:     <video>
Aug 17 16:33:08 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:33:08 user nova-compute[72724]:     </video>
Aug 17 16:33:08 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:33:08 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:33:08 user nova-compute[72724]:     </rng>
Aug 17 16:33:08 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:33:08 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:33:08 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:33:08 user nova-compute[72724]:     </memballoon>
Aug 17 16:33:08 user nova-compute[72724]:   </devices>
Aug 17 16:33:08 user nova-compute[72724]: </domain>
Aug 17 16:33:08 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-336069617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-336069617',id=19,image_ref='e5a3b370-c3de-46a0-b099-b9d2ff351626',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-11081656',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:29:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-ok1ep51j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member',shelved_at='2023-08-17T16:31:13.694861',shelved_host='user',shelved_image_id='e5a3b370-c3de-46a0-b099-b9d2ff351626'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:33:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=194a5ac4-9157-49c2-beeb-86698432abb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG os_vif [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3be4c18a-38, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3be4c18a-38, col_values=(('external_ids', {'iface-id': '3be4c18a-383a-464f-a54e-dde317ef8fb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:04:93:1d', 'vm-uuid': '194a5ac4-9157-49c2-beeb-86698432abb3'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:08 user nova-compute[72724]: INFO os_vif [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38')
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] No VIF found with MAC fa:16:3e:04:93:1d, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:33:08 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Took 0.65 seconds to deallocate network for instance.
Aug 17 16:33:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-e742cc97-00e1-4154-8985-a847b6889391 req-54d30478-2a93-4b32-80b3-2a33049fc838 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-vif-deleted-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:09 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Deleted allocations for instance 3d935f81-a7d9-416d-9f44-4d1afd2b16b9
Aug 17 16:33:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8485cca9-3ca3-411d-9246-03ce5bb99a5a tempest-VolumesNegativeTest-2032580775 tempest-VolumesNegativeTest-2032580775-project-member] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.116s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-2fd86f0b-5c8d-42a8-bdd4-a47a7fadd095 req-7207673c-ebb9-47be-9a90-915b4585c975 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received event network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2fd86f0b-5c8d-42a8-bdd4-a47a7fadd095 req-7207673c-ebb9-47be-9a90-915b4585c975 service nova] Acquiring lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2fd86f0b-5c8d-42a8-bdd4-a47a7fadd095 req-7207673c-ebb9-47be-9a90-915b4585c975 service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2fd86f0b-5c8d-42a8-bdd4-a47a7fadd095 req-7207673c-ebb9-47be-9a90-915b4585c975 service nova] Lock "3d935f81-a7d9-416d-9f44-4d1afd2b16b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-2fd86f0b-5c8d-42a8-bdd4-a47a7fadd095 req-7207673c-ebb9-47be-9a90-915b4585c975 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] No waiting events found dispatching network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:09 user nova-compute[72724]: WARNING nova.compute.manager [req-2fd86f0b-5c8d-42a8-bdd4-a47a7fadd095 req-7207673c-ebb9-47be-9a90-915b4585c975 service nova] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Received unexpected event network-vif-plugged-55e89de7-e83f-4c81-8714-44769e127f95 for instance with vm_state deleted and task_state None.
Aug 17 16:33:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:11 user nova-compute[72724]: WARNING nova.compute.manager [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:11 user nova-compute[72724]: WARNING nova.compute.manager [req-f2f11a8f-f47c-4780-bf10-a52c75c797d7 req-a51438ef-b1b2-4017-8631-5be6e420ef4a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289991.9087694, 194a5ac4-9157-49c2-beeb-86698432abb3 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:33:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] VM Resumed (Lifecycle Event)
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:33:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance spawned successfully.
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:33:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692289991.9120107, 194a5ac4-9157-49c2-beeb-86698432abb3 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:33:11 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] VM Started (Lifecycle Event)
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:33:12 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:33:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d18fcef9-1106-4bb4-8ba2-f138702cad42 tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.458s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:17 user nova-compute[72724]: INFO nova.compute.manager [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Terminating instance
Aug 17 16:33:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9e0c9eb0-4644-47f4-9cfe-6f842d67db79 req-fda510cd-2960-43d0-992b-4036ae48b152 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-unplugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9e0c9eb0-4644-47f4-9cfe-6f842d67db79 req-fda510cd-2960-43d0-992b-4036ae48b152 service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9e0c9eb0-4644-47f4-9cfe-6f842d67db79 req-fda510cd-2960-43d0-992b-4036ae48b152 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9e0c9eb0-4644-47f4-9cfe-6f842d67db79 req-fda510cd-2960-43d0-992b-4036ae48b152 service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9e0c9eb0-4644-47f4-9cfe-6f842d67db79 req-fda510cd-2960-43d0-992b-4036ae48b152 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-unplugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9e0c9eb0-4644-47f4-9cfe-6f842d67db79 req-fda510cd-2960-43d0-992b-4036ae48b152 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-unplugged-09b43135-e018-4125-a820-19789671d5b9 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Instance destroyed successfully.
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lazy-loading 'resources' on Instance uuid 13399825-a90e-47f5-9bb2-925cba27bff2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:29:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-2097568250',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-317110015',id=20,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHvByM9UX/8Vi26Q+yKbGDVBwc5mNimk3Dy4Ux+JPhRuokT0dC9DNT4SryLFdLBhKeKjIz7xsEhbXUxzo7jReG6+1JD4yno55EzcuSlj0pcymi0STVXaiytWojf87+GIew==',key_name='tempest-keypair-1145346431',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:32:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='901d2a4375044098bb152fde8698dfe5',ramdisk_id='',reservation_id='r-hipkov7x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1362885906',owner_user_name='tempest-ServerActionsV293TestJSON-1362885906-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:32:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11c91fd3d13a48d7b299488ab320ce2c',uuid=13399825-a90e-47f5-9bb2-925cba27bff2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converting VIF {"id": "09b43135-e018-4125-a820-19789671d5b9", "address": "fa:16:3e:30:c1:55", "network": {"id": "46222546-0d27-45ee-a845-65421c51297f", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1147936218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "901d2a4375044098bb152fde8698dfe5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09b43135-e0", "ovs_interfaceid": "09b43135-e018-4125-a820-19789671d5b9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_vif [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09b43135-e0, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:33:18 user nova-compute[72724]: INFO os_vif [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:c1:55,bridge_name='br-int',has_traffic_filtering=True,id=09b43135-e018-4125-a820-19789671d5b9,network=Network(46222546-0d27-45ee-a845-65421c51297f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09b43135-e0')
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'baPRlsmy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:33:18 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5414c9b7-99e7-4afb-b41f-6fec81c01428]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f56197b-935a-47b0-84d5-95ae6bc5b011]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:33:18 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:33:18 user nova-compute[72724]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:33:18 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:33:18 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:33:18 user nova-compute[72724]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 (non-flash)
Aug 17 16:33:18 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e8118ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cca6bb1-c6c4-4772-b311-509d25c3d396]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d2c164-c392-48f1-b2b3-413da97f370e]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eb9b0fb-46fe-4033-9899-3e48ed4baeae]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23c1232-d1ff-4227-8ca1-80242962a6fe]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2f020d26', '/dev/disk/by-id/scsi-1SCST_BIO2f020d26-e0305ee13f6f73c5', '/dev/disk/by-id/scsi-26530333035656531') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[678e225c-09e5-4d87-9e27-747d8ddbffca]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b58314d-7ad9-4846-8656-0f4b6864baf8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f637240-a2f1-487f-ab67-acf0093ce212]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260]
Aug 17 16:33:18 user nova-compute[72724]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820, portal: 172.16.0.220,3260] successful.
Aug 17 16:33:18 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f14a02a1-0a3d-4b12-8c18-f3937a439820 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a78afa-cce5-4172-bd97-8650433f60ba]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] <== disconnect_volume: return (289ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:33:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Deleting instance files /opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2_del
Aug 17 16:33:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Deletion of /opt/stack/data/nova/instances/13399825-a90e-47f5-9bb2-925cba27bff2_del complete
Aug 17 16:33:18 user nova-compute[72724]: INFO nova.compute.manager [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 17 16:33:18 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:33:18 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:33:19 user nova-compute[72724]: INFO nova.compute.manager [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Unrescuing
Aug 17 16:33:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG nova.objects.instance [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'flavor' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-ef423393-f5b3-4a3d-ade5-348e202b645c req-c2b21818-0825-4424-a42b-f272cb5dec7a service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ef423393-f5b3-4a3d-ade5-348e202b645c req-c2b21818-0825-4424-a42b-f272cb5dec7a service nova] Acquiring lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ef423393-f5b3-4a3d-ade5-348e202b645c req-c2b21818-0825-4424-a42b-f272cb5dec7a service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ef423393-f5b3-4a3d-ade5-348e202b645c req-c2b21818-0825-4424-a42b-f272cb5dec7a service nova] Lock "13399825-a90e-47f5-9bb2-925cba27bff2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-ef423393-f5b3-4a3d-ade5-348e202b645c req-c2b21818-0825-4424-a42b-f272cb5dec7a service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] No waiting events found dispatching network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:19 user nova-compute[72724]: WARNING nova.compute.manager [req-ef423393-f5b3-4a3d-ade5-348e202b645c req-c2b21818-0825-4424-a42b-f272cb5dec7a service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received unexpected event network-vif-plugged-09b43135-e018-4125-a820-19789671d5b9 for instance with vm_state active and task_state deleting.
Aug 17 16:33:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-7edf1a30-4004-44d3-a5f8-c66c4409b823 req-bf1732fa-c67c-4b76-b828-27ba1a5e225e service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7edf1a30-4004-44d3-a5f8-c66c4409b823 req-bf1732fa-c67c-4b76-b828-27ba1a5e225e service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7edf1a30-4004-44d3-a5f8-c66c4409b823 req-bf1732fa-c67c-4b76-b828-27ba1a5e225e service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7edf1a30-4004-44d3-a5f8-c66c4409b823 req-bf1732fa-c67c-4b76-b828-27ba1a5e225e service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-7edf1a30-4004-44d3-a5f8-c66c4409b823 req-bf1732fa-c67c-4b76-b828-27ba1a5e225e service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:20 user nova-compute[72724]: WARNING nova.compute.manager [req-7edf1a30-4004-44d3-a5f8-c66c4409b823 req-bf1732fa-c67c-4b76-b828-27ba1a5e225e service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:33:20 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:33:20 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Took 2.08 seconds to deallocate network for instance.
Aug 17 16:33:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-f03e46e9-c0c5-4651-9c99-d0c96a3e16c4 req-2ba0ea48-635f-463a-beb3-4a4d78355b60 service nova] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Received event network-vif-deleted-09b43135-e018-4125-a820-19789671d5b9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance destroyed successfully.
Aug 17 16:33:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:21 user nova-compute[72724]: INFO nova.compute.manager [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Took 0.88 seconds to detach 1 volumes for instance.
Aug 17 16:33:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Deleting volume: f14a02a1-0a3d-4b12-8c18-f3937a439820 {{(pid=72724) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 16:33:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:22 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Deleted allocations for instance 13399825-a90e-47f5-9bb2-925cba27bff2
Aug 17 16:33:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-409d446b-64e7-4848-a723-caff9b4f4a46 tempest-ServerActionsV293TestJSON-1362885906 tempest-ServerActionsV293TestJSON-1362885906-project-member] Lock "13399825-a90e-47f5-9bb2-925cba27bff2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.789s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-50323128-bbfb-4c00-ba93-b81dd94af9de req-c3595169-f930-455b-9f95-d056b3eca44a service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50323128-bbfb-4c00-ba93-b81dd94af9de req-c3595169-f930-455b-9f95-d056b3eca44a service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50323128-bbfb-4c00-ba93-b81dd94af9de req-c3595169-f930-455b-9f95-d056b3eca44a service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50323128-bbfb-4c00-ba93-b81dd94af9de req-c3595169-f930-455b-9f95-d056b3eca44a service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-50323128-bbfb-4c00-ba93-b81dd94af9de req-c3595169-f930-455b-9f95-d056b3eca44a service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:22 user nova-compute[72724]: WARNING nova.compute.manager [req-50323128-bbfb-4c00-ba93-b81dd94af9de req-c3595169-f930-455b-9f95-d056b3eca44a service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:33:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:22 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289987.9545722, 3d935f81-a7d9-416d-9f44-4d1afd2b16b9 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:33:22 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] VM Stopped (Lifecycle Event)
Aug 17 16:33:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-46f78cb4-4ad9-4f00-a32f-26fe19fc384a None None] [instance: 3d935f81-a7d9-416d-9f44-4d1afd2b16b9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:24 user nova-compute[72724]: WARNING nova.compute.manager [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:33:24 user nova-compute[72724]: WARNING nova.compute.manager [req-0829072c-7490-4fe3-ba83-08103f60d748 req-34a02c8d-551a-4930-ab38-f3d541d8615c service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for f09067a8-3cf3-4fe7-aa75-78348da59adb due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290004.3849971, f09067a8-3cf3-4fe7-aa75-78348da59adb => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:33:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Resumed (Lifecycle Event)
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-34dd5d66-f5b0-473a-b067-329bf7b9d2b0 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:33:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290004.3862116, f09067a8-3cf3-4fe7-aa75-78348da59adb => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:33:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Started (Lifecycle Event)
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:33:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:33 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692289998.1917486, 13399825-a90e-47f5-9bb2-925cba27bff2 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:33:33 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] VM Stopped (Lifecycle Event)
Aug 17 16:33:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-bd7bb6e7-f2f4-4cbe-a4dc-fc362b57c0b0 None None] [instance: 13399825-a90e-47f5-9bb2-925cba27bff2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:33:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:33:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updating instance_info_cache with network_info: [{"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-7e5312b5-8900-4739-a8a6-06efbcbc819c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:33:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:40 user nova-compute[72724]: INFO nova.compute.manager [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Detaching volume c0846b81-a46e-4232-a4d2-8c2d2399af8f
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:41 user nova-compute[72724]: INFO nova.virt.block_device [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Attempting to driver detach volume c0846b81-a46e-4232-a4d2-8c2d2399af8f from mountpoint /dev/vdb
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Attempting to detach device vdb from instance 83f9af1c-ac8e-4164-8099-59b353263047 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:33:41 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:33:41 user nova-compute[72724]:   <source dev="/dev/sdd"/>
Aug 17 16:33:41 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:33:41 user nova-compute[72724]:   <serial>c0846b81-a46e-4232-a4d2-8c2d2399af8f</serial>
Aug 17 16:33:41 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 16:33:41 user nova-compute[72724]: </disk>
Aug 17 16:33:41 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:33:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully detached device vdb from instance 83f9af1c-ac8e-4164-8099-59b353263047 from the persistent domain config.
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83f9af1c-ac8e-4164-8099-59b353263047 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:33:41 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:33:41 user nova-compute[72724]:   <source dev="/dev/sdd"/>
Aug 17 16:33:41 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:33:41 user nova-compute[72724]:   <serial>c0846b81-a46e-4232-a4d2-8c2d2399af8f</serial>
Aug 17 16:33:41 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 16:33:41 user nova-compute[72724]: </disk>
Aug 17 16:33:41 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290021.4520156, 83f9af1c-ac8e-4164-8099-59b353263047 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:33:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully detached device vdb from instance 83f9af1c-ac8e-4164-8099-59b353263047 from the live domain config.
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'muHLvOES', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:33:41 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6fdc4b-9133-4899-9947-e813230a8a79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fc7268-f2f6-46aa-8b8c-1ba655d14c9f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:33:41 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:33:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:33:41 user nova-compute[72724]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f (non-flash)
Aug 17 16:33:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8412170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f'): ({'sdd'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Removing single pathed devices sdd {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56758bf-3d2e-41e5-83a1-786d2bf7fdae]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe886b5f-451b-4c08-bfbf-fa675bdb12ea]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flushing IO for device /dev/sdd {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adbca97-02c7-43c9-8803-51c988f898eb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d380cde-e2ec-4ac5-882a-9af5eb051337]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[68109975-c73e-42b6-abb9-2f45b3f45f04]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cf4713-3b25-4813-8378-5515a2c40df1]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260]
Aug 17 16:33:41 user nova-compute[72724]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f, portal: 172.16.0.220,3260] successful.
Aug 17 16:33:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0846b81-a46e-4232-a4d2-8c2d2399af8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[11479990-55ab-4a0e-94e0-00e379c194a6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== disconnect_volume: return (301ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'flavor' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fa92afba-7c87-402f-b5f1-23a00298b350 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.687s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:33:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7869MB free_disk=25.48476791381836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 83f9af1c-ac8e-4164-8099-59b353263047 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 194a5ac4-9157-49c2-beeb-86698432abb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:33:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:33:44 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:33:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:33:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:33:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:16 user nova-compute[72724]: INFO nova.compute.manager [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Unrescuing
Aug 17 16:34:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:34:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:34:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'flavor' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance destroyed successfully.
Aug 17 16:34:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7a8c887c-cdd8-45fe-ab3e-f309ad9cdcc5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 00db2a89-a70b-461d-a887-ccba383edce6 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290061.690329, 00db2a89-a70b-461d-a887-ccba383edce6 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:34:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Resumed (Lifecycle Event)
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:34:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290061.6906588, 00db2a89-a70b-461d-a887-ccba383edce6 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:34:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Started (Lifecycle Event)
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:34:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-9a3ff7f7-3e64-4e06-b4c0-eb7a42e5149a req-1e849ecb-7f7f-45ed-9748-c5c56549593f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a3ff7f7-3e64-4e06-b4c0-eb7a42e5149a req-1e849ecb-7f7f-45ed-9748-c5c56549593f service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a3ff7f7-3e64-4e06-b4c0-eb7a42e5149a req-1e849ecb-7f7f-45ed-9748-c5c56549593f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9a3ff7f7-3e64-4e06-b4c0-eb7a42e5149a req-1e849ecb-7f7f-45ed-9748-c5c56549593f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-9a3ff7f7-3e64-4e06-b4c0-eb7a42e5149a req-1e849ecb-7f7f-45ed-9748-c5c56549593f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:22 user nova-compute[72724]: WARNING nova.compute.manager [req-9a3ff7f7-3e64-4e06-b4c0-eb7a42e5149a req-1e849ecb-7f7f-45ed-9748-c5c56549593f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state None.
Aug 17 16:34:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:24 user nova-compute[72724]: WARNING nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state None.
Aug 17 16:34:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:24 user nova-compute[72724]: WARNING nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state None.
Aug 17 16:34:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:24 user nova-compute[72724]: WARNING nova.compute.manager [req-a1298c4b-b5bc-45c6-9102-0ca843a9c1d6 req-9a9c3ad5-db5a-4c71-8ec4-55394db5366f service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state None.
Aug 17 16:34:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:31 user nova-compute[72724]: INFO nova.compute.manager [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Terminating instance
Aug 17 16:34:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-257ebfd4-8c0f-4440-9fd5-4aefd625cb64 req-fd3e8b0d-3faa-4b95-8816-314fbef79649 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-unplugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-257ebfd4-8c0f-4440-9fd5-4aefd625cb64 req-fd3e8b0d-3faa-4b95-8816-314fbef79649 service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-257ebfd4-8c0f-4440-9fd5-4aefd625cb64 req-fd3e8b0d-3faa-4b95-8816-314fbef79649 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-257ebfd4-8c0f-4440-9fd5-4aefd625cb64 req-fd3e8b0d-3faa-4b95-8816-314fbef79649 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-257ebfd4-8c0f-4440-9fd5-4aefd625cb64 req-fd3e8b0d-3faa-4b95-8816-314fbef79649 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-unplugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-257ebfd4-8c0f-4440-9fd5-4aefd625cb64 req-fd3e8b0d-3faa-4b95-8816-314fbef79649 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-unplugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:34:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Instance destroyed successfully.
Aug 17 16:34:32 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'resources' on Instance uuid 83f9af1c-ac8e-4164-8099-59b353263047 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:28:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1821486414',display_name='tempest-ServerActionsTestOtherA-server-96438778',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1821486414',id=18,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHXLwwxkDku5rfnP8iYXTIEqll3oksBJas5Od/7/rp7seEVlxZtrleII/0owGqphwukPIlWXazaavg1ZJNT2OUGOxT7wuEMTgxdn/HAhS2rlB0gZ41Sp66cQeSkkAHL9A==',key_name='tempest-keypair-1823955780',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:31:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-0gnojs1b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:31:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=83f9af1c-ac8e-4164-8099-59b353263047,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "1380c6c7-265d-4064-9302-6c037bb6684c", "address": "fa:16:3e:58:aa:15", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1380c6c7-26", "ovs_interfaceid": "1380c6c7-265d-4064-9302-6c037bb6684c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG os_vif [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1380c6c7-26, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:34:32 user nova-compute[72724]: INFO os_vif [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:58:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=1380c6c7-265d-4064-9302-6c037bb6684c,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1380c6c7-26')
Aug 17 16:34:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Deleting instance files /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047_del
Aug 17 16:34:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Deletion of /opt/stack/data/nova/instances/83f9af1c-ac8e-4164-8099-59b353263047_del complete
Aug 17 16:34:32 user nova-compute[72724]: INFO nova.compute.manager [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 16:34:32 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:34:32 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:33 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Took 1.13 seconds to deallocate network for instance.
Aug 17 16:34:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-b7bc70d7-0307-4e95-9c79-807aaa434b86 req-eb75f29e-cb41-4db7-8b5f-a0dd5e5c9db1 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-deleted-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:33 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Deleted allocations for instance 83f9af1c-ac8e-4164-8099-59b353263047
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5672a01d-e49b-4860-813d-5722f8997507 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "83f9af1c-ac8e-4164-8099-59b353263047" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.455s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-28072a4d-e19c-453f-81db-64dd94413fd7 req-1df60a1e-345d-4fe6-9d7f-bd49051d5576 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-28072a4d-e19c-453f-81db-64dd94413fd7 req-1df60a1e-345d-4fe6-9d7f-bd49051d5576 service nova] Acquiring lock "83f9af1c-ac8e-4164-8099-59b353263047-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-28072a4d-e19c-453f-81db-64dd94413fd7 req-1df60a1e-345d-4fe6-9d7f-bd49051d5576 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-28072a4d-e19c-453f-81db-64dd94413fd7 req-1df60a1e-345d-4fe6-9d7f-bd49051d5576 service nova] Lock "83f9af1c-ac8e-4164-8099-59b353263047-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-28072a4d-e19c-453f-81db-64dd94413fd7 req-1df60a1e-345d-4fe6-9d7f-bd49051d5576 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] No waiting events found dispatching network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:33 user nova-compute[72724]: WARNING nova.compute.manager [req-28072a4d-e19c-453f-81db-64dd94413fd7 req-1df60a1e-345d-4fe6-9d7f-bd49051d5576 service nova] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Received unexpected event network-vif-plugged-1380c6c7-265d-4064-9302-6c037bb6684c for instance with vm_state deleted and task_state None.
Aug 17 16:34:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:34:35 user nova-compute[72724]: INFO nova.compute.claims [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Claim successful on node user
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:34:35 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.policy [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a441dd986f9a417aaa3034dca1e0c9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6683a9e4cd8a44cfb2c5b3be805e57ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:34:35 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Creating image(s)
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "/opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "/opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk 1073741824" returned: 0 in 0.109s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.305s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.222s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Successfully created port: c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Cannot resize image /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'migration_context' on Instance uuid 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Ensure instance console log exists: /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Successfully updated port: c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquired lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-changed-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Refreshing instance network info cache due to event network-changed-c26d4137-dcae-4c05-a416-906feff579bc. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] Acquiring lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updating instance_info_cache with network_info: [{"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Releasing lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Instance network_info: |[{"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] Acquired lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.neutron [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Refreshing network info cache for port c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Start _get_guest_xml network_info=[{"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:34:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:34:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1747638424',display_name='tempest-VolumesSnapshotTestJSON-instance-1747638424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1747638424',id=23,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8pSZNjB/YEO5w5lfyvfOZfzHArNL5mdOCdsh3dh6xWOJMiAgXpnumjVMimIKwibPlTxTv8IUtSWHeikS1zMiqk4g8hP/Auo1wZ4/3Mgdc7cM11O+ekjd8PcwVngbuk+A==',key_name='tempest-keypair-951556577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6683a9e4cd8a44cfb2c5b3be805e57ef',ramdisk_id='',reservation_id='r-v6kid5vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-684431818',owner_user_name='tempest-VolumesSnapshotTestJSON-684431818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a441dd986f9a417aaa3034dca1e0c9ad',uuid=5e3de8b0-fa50-4e3a-8166-8be17ca8c35e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converting VIF {"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:34:37 user nova-compute[72724]:   <uuid>5e3de8b0-fa50-4e3a-8166-8be17ca8c35e</uuid>
Aug 17 16:34:37 user nova-compute[72724]:   <name>instance-00000017</name>
Aug 17 16:34:37 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:34:37 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:34:37 user nova-compute[72724]:   <metadata>
Aug 17 16:34:37 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:34:37 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:34:37 user nova-compute[72724]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1747638424</nova:name>
Aug 17 16:34:37 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:34:37</nova:creationTime>
Aug 17 16:34:37 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:34:37 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:34:37 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:34:37 user nova-compute[72724]:       <nova:owner>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:user uuid="a441dd986f9a417aaa3034dca1e0c9ad">tempest-VolumesSnapshotTestJSON-684431818-project-member</nova:user>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:project uuid="6683a9e4cd8a44cfb2c5b3be805e57ef">tempest-VolumesSnapshotTestJSON-684431818</nova:project>
Aug 17 16:34:37 user nova-compute[72724]:       </nova:owner>
Aug 17 16:34:37 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:34:37 user nova-compute[72724]:       <nova:ports>
Aug 17 16:34:37 user nova-compute[72724]:         <nova:port uuid="c26d4137-dcae-4c05-a416-906feff579bc">
Aug 17 16:34:37 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 17 16:34:37 user nova-compute[72724]:         </nova:port>
Aug 17 16:34:37 user nova-compute[72724]:       </nova:ports>
Aug 17 16:34:37 user nova-compute[72724]:     </nova:instance>
Aug 17 16:34:37 user nova-compute[72724]:   </metadata>
Aug 17 16:34:37 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:34:37 user nova-compute[72724]:     <system>
Aug 17 16:34:37 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:34:37 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:34:37 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:34:37 user nova-compute[72724]:       <entry name="serial">5e3de8b0-fa50-4e3a-8166-8be17ca8c35e</entry>
Aug 17 16:34:37 user nova-compute[72724]:       <entry name="uuid">5e3de8b0-fa50-4e3a-8166-8be17ca8c35e</entry>
Aug 17 16:34:37 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:34:37 user nova-compute[72724]:     </system>
Aug 17 16:34:37 user nova-compute[72724]:   </sysinfo>
Aug 17 16:34:37 user nova-compute[72724]:   <os>
Aug 17 16:34:37 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:34:37 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:34:37 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:34:37 user nova-compute[72724]:   </os>
Aug 17 16:34:37 user nova-compute[72724]:   <features>
Aug 17 16:34:37 user nova-compute[72724]:     <acpi/>
Aug 17 16:34:37 user nova-compute[72724]:     <apic/>
Aug 17 16:34:37 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:34:37 user nova-compute[72724]:   </features>
Aug 17 16:34:37 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:34:37 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:34:37 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:34:37 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:34:37 user nova-compute[72724]:   </clock>
Aug 17 16:34:37 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:34:37 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:34:37 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:34:37 user nova-compute[72724]:   </cpu>
Aug 17 16:34:37 user nova-compute[72724]:   <devices>
Aug 17 16:34:37 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:34:37 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:34:37 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk"/>
Aug 17 16:34:37 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:34:37 user nova-compute[72724]:     </disk>
Aug 17 16:34:37 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:34:37 user nova-compute[72724]:       <mac address="fa:16:3e:cb:a6:2a"/>
Aug 17 16:34:37 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:34:37 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:34:37 user nova-compute[72724]:       <target dev="tapc26d4137-dc"/>
Aug 17 16:34:37 user nova-compute[72724]:     </interface>
Aug 17 16:34:37 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:34:37 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/console.log" append="off"/>
Aug 17 16:34:37 user nova-compute[72724]:     </serial>
Aug 17 16:34:37 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:34:37 user nova-compute[72724]:     <video>
Aug 17 16:34:37 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:34:37 user nova-compute[72724]:     </video>
Aug 17 16:34:37 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:34:37 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:34:37 user nova-compute[72724]:     </rng>
Aug 17 16:34:37 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:34:37 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:34:37 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:34:37 user nova-compute[72724]:     </memballoon>
Aug 17 16:34:37 user nova-compute[72724]:   </devices>
Aug 17 16:34:37 user nova-compute[72724]: </domain>
Aug 17 16:34:37 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1747638424',display_name='tempest-VolumesSnapshotTestJSON-instance-1747638424',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1747638424',id=23,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8pSZNjB/YEO5w5lfyvfOZfzHArNL5mdOCdsh3dh6xWOJMiAgXpnumjVMimIKwibPlTxTv8IUtSWHeikS1zMiqk4g8hP/Auo1wZ4/3Mgdc7cM11O+ekjd8PcwVngbuk+A==',key_name='tempest-keypair-951556577',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6683a9e4cd8a44cfb2c5b3be805e57ef',ramdisk_id='',reservation_id='r-v6kid5vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-684431818',owner_user_name='tempest-VolumesSnapshotTestJSON-684431818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:34:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a441dd986f9a417aaa3034dca1e0c9ad',uuid=5e3de8b0-fa50-4e3a-8166-8be17ca8c35e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converting VIF {"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG os_vif [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc26d4137-dc, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc26d4137-dc, col_values=(('external_ids', {'iface-id': 'c26d4137-dcae-4c05-a416-906feff579bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:a6:2a', 'vm-uuid': '5e3de8b0-fa50-4e3a-8166-8be17ca8c35e'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:37 user nova-compute[72724]: INFO os_vif [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc')
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:34:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No VIF found with MAC fa:16:3e:cb:a6:2a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:34:38 user nova-compute[72724]: DEBUG nova.network.neutron [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updated VIF entry in instance network info cache for port c26d4137-dcae-4c05-a416-906feff579bc. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:34:38 user nova-compute[72724]: DEBUG nova.network.neutron [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updating instance_info_cache with network_info: [{"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac29382d-3388-4201-bda5-f7c170a564f6 req-63aec274-051b-4382-97dc-42ac4301a894 service nova] Releasing lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-b045e503-b21c-4060-89a4-58ac94b99d6d req-b6f842cb-bc1c-4468-a20d-2d546e18a462 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b045e503-b21c-4060-89a4-58ac94b99d6d req-b6f842cb-bc1c-4468-a20d-2d546e18a462 service nova] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b045e503-b21c-4060-89a4-58ac94b99d6d req-b6f842cb-bc1c-4468-a20d-2d546e18a462 service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b045e503-b21c-4060-89a4-58ac94b99d6d req-b6f842cb-bc1c-4468-a20d-2d546e18a462 service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-b045e503-b21c-4060-89a4-58ac94b99d6d req-b6f842cb-bc1c-4468-a20d-2d546e18a462 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] No waiting events found dispatching network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:39 user nova-compute[72724]: WARNING nova.compute.manager [req-b045e503-b21c-4060-89a4-58ac94b99d6d req-b6f842cb-bc1c-4468-a20d-2d546e18a462 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received unexpected event network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc for instance with vm_state building and task_state spawning.
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290081.4706492, 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] VM Resumed (Lifecycle Event)
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9c637a6-e1aa-494e-a9e1-0e743a2a1a99 req-b7fd9dab-7716-4d6f-9988-883455d3d5ad service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9c637a6-e1aa-494e-a9e1-0e743a2a1a99 req-b7fd9dab-7716-4d6f-9988-883455d3d5ad service nova] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9c637a6-e1aa-494e-a9e1-0e743a2a1a99 req-b7fd9dab-7716-4d6f-9988-883455d3d5ad service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9c637a6-e1aa-494e-a9e1-0e743a2a1a99 req-b7fd9dab-7716-4d6f-9988-883455d3d5ad service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9c637a6-e1aa-494e-a9e1-0e743a2a1a99 req-b7fd9dab-7716-4d6f-9988-883455d3d5ad service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] No waiting events found dispatching network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:41 user nova-compute[72724]: WARNING nova.compute.manager [req-e9c637a6-e1aa-494e-a9e1-0e743a2a1a99 req-b7fd9dab-7716-4d6f-9988-883455d3d5ad service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received unexpected event network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc for instance with vm_state building and task_state spawning.
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Instance spawned successfully.
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290081.4726918, 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] VM Started (Lifecycle Event)
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Took 5.95 seconds to spawn the instance on the hypervisor.
Aug 17 16:34:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:41 user nova-compute[72724]: INFO nova.compute.manager [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Took 6.65 seconds to build instance.
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5ff560a9-a636-4463-98e6-fd776125df11 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.776s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:34:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:34:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8049MB free_disk=25.501708984375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7e5312b5-8900-4739-a8a6-06efbcbc819c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 194a5ac4-9157-49c2-beeb-86698432abb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:34:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:34:44 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:34:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.448s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:34:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:34:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:47 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290072.0013583, 83f9af1c-ac8e-4164-8099-59b353263047 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:34:47 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] VM Stopped (Lifecycle Event)
Aug 17 16:34:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6ba159bb-601a-43fa-97e6-a86918cd85fe None None] [instance: 83f9af1c-ac8e-4164-8099-59b353263047] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:34:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:52 user nova-compute[72724]: INFO nova.compute.manager [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Terminating instance
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-4c0311df-0957-4b73-86a9-350c130287e6 req-1478d7b5-62f2-4433-917e-f0e0f6fd2d4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-unplugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4c0311df-0957-4b73-86a9-350c130287e6 req-1478d7b5-62f2-4433-917e-f0e0f6fd2d4e service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4c0311df-0957-4b73-86a9-350c130287e6 req-1478d7b5-62f2-4433-917e-f0e0f6fd2d4e service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4c0311df-0957-4b73-86a9-350c130287e6 req-1478d7b5-62f2-4433-917e-f0e0f6fd2d4e service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-4c0311df-0957-4b73-86a9-350c130287e6 req-1478d7b5-62f2-4433-917e-f0e0f6fd2d4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-unplugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-4c0311df-0957-4b73-86a9-350c130287e6 req-1478d7b5-62f2-4433-917e-f0e0f6fd2d4e service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-unplugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:34:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Instance destroyed successfully.
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lazy-loading 'resources' on Instance uuid 194a5ac4-9157-49c2-beeb-86698432abb3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:29:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-336069617',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-336069617',id=19,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5YB99VGoL3C3YdDwPY4qPwMFdUgKGIXY4faMBXjKJkjNyuqAANHxfNjGVk4UBrSA8bu4w1Xlk3KtWBh7CWLLyipmf0SGDC5vy5q6kux/27Jsq/NiqNKuMFHHvasvzFBw==',key_name='tempest-keypair-11081656',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:33:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='43b9b4c4d963430e95e8b6fb484c9889',ramdisk_id='',reservation_id='r-ok1ep51j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-239110034',owner_user_name='tempest-AttachVolumeShelveTestJSON-239110034-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8041c5cb8ad64f64b31aab70052e4f02',uuid=194a5ac4-9157-49c2-beeb-86698432abb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converting VIF {"id": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "address": "fa:16:3e:04:93:1d", "network": {"id": "bdc94fcc-65a5-4cd0-b1fa-55c90cca8699", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1749704806-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.32", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "43b9b4c4d963430e95e8b6fb484c9889", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3be4c18a-38", "ovs_interfaceid": "3be4c18a-383a-464f-a54e-dde317ef8fb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG os_vif [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3be4c18a-38, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:34:52 user nova-compute[72724]: INFO os_vif [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:04:93:1d,bridge_name='br-int',has_traffic_filtering=True,id=3be4c18a-383a-464f-a54e-dde317ef8fb4,network=Network(bdc94fcc-65a5-4cd0-b1fa-55c90cca8699),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3be4c18a-38')
Aug 17 16:34:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Deleting instance files /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3_del
Aug 17 16:34:52 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Deletion of /opt/stack/data/nova/instances/194a5ac4-9157-49c2-beeb-86698432abb3_del complete
Aug 17 16:34:52 user nova-compute[72724]: INFO nova.compute.manager [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 17 16:34:52 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:34:52 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:34:53 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:53 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Took 1.02 seconds to deallocate network for instance.
Aug 17 16:34:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-0509eea8-146e-4628-897d-b972170e83ee req-e1754ef3-0e80-41fb-a0c0-79d1d5c9472b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-deleted-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:53 user nova-compute[72724]: INFO nova.compute.manager [req-0509eea8-146e-4628-897d-b972170e83ee req-e1754ef3-0e80-41fb-a0c0-79d1d5c9472b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Neutron deleted interface 3be4c18a-383a-464f-a54e-dde317ef8fb4; detaching it from the instance and deleting it from the info cache
Aug 17 16:34:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-0509eea8-146e-4628-897d-b972170e83ee req-e1754ef3-0e80-41fb-a0c0-79d1d5c9472b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:34:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-0509eea8-146e-4628-897d-b972170e83ee req-e1754ef3-0e80-41fb-a0c0-79d1d5c9472b service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Detach interface failed, port_id=3be4c18a-383a-464f-a54e-dde317ef8fb4, reason: Instance 194a5ac4-9157-49c2-beeb-86698432abb3 could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:34:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:54 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Deleted allocations for instance 194a5ac4-9157-49c2-beeb-86698432abb3
Aug 17 16:34:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2dfcc922-d469-4cd2-a4b0-0bced50b17cb tempest-AttachVolumeShelveTestJSON-239110034 tempest-AttachVolumeShelveTestJSON-239110034-project-member] Lock "194a5ac4-9157-49c2-beeb-86698432abb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-0bdf1301-63b4-42c1-9ff3-1617f6f1a89e req-cca65bc6-f400-444c-a02b-03610a11081a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0bdf1301-63b4-42c1-9ff3-1617f6f1a89e req-cca65bc6-f400-444c-a02b-03610a11081a service nova] Acquiring lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0bdf1301-63b4-42c1-9ff3-1617f6f1a89e req-cca65bc6-f400-444c-a02b-03610a11081a service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0bdf1301-63b4-42c1-9ff3-1617f6f1a89e req-cca65bc6-f400-444c-a02b-03610a11081a service nova] Lock "194a5ac4-9157-49c2-beeb-86698432abb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:34:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-0bdf1301-63b4-42c1-9ff3-1617f6f1a89e req-cca65bc6-f400-444c-a02b-03610a11081a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] No waiting events found dispatching network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:34:54 user nova-compute[72724]: WARNING nova.compute.manager [req-0bdf1301-63b4-42c1-9ff3-1617f6f1a89e req-cca65bc6-f400-444c-a02b-03610a11081a service nova] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Received unexpected event network-vif-plugged-3be4c18a-383a-464f-a54e-dde317ef8fb4 for instance with vm_state deleted and task_state None.
Aug 17 16:34:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:07 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290092.6092792, 194a5ac4-9157-49c2-beeb-86698432abb3 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:35:07 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] VM Stopped (Lifecycle Event)
Aug 17 16:35:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a4f199af-8d66-49f0-992f-83ea6b0ecef0 None None] [instance: 194a5ac4-9157-49c2-beeb-86698432abb3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:35:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:35:17 user nova-compute[72724]: INFO nova.compute.claims [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Claim successful on node user
Aug 17 16:35:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:35:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:35:17 user nova-compute[72724]: DEBUG nova.policy [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '558eaa9f170b40978f6004f1e6aff3e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4767040317048ddb4479fa7c82f3384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:35:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Creating image(s)
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.227s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.232s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk 1073741824" returned: 0 in 0.057s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.222s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Successfully created port: 8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Cannot resize image /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'migration_context' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Ensure instance console log exists: /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Successfully updated port: 8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:35:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing instance network info cache due to event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance network_info: |[{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.neutron [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Start _get_guest_xml network_info=[{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:35:20 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:35:20 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397944758',display_name='tempest-ServerRescueNegativeTestJSON-server-1397944758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397944758',id=24,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQRfAZt3m1Vbla0QpTze19m2E1AgtC8ej49fucwgZCpaFExpHOyf9jM3x5bfi79G3s3CpOU3wGg35OZn/8FI6ddnu9ythH77PTmrNaDcxjCrfDX6weaaXhmKQ22ng5nqw==',key_name='tempest-keypair-1998249459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-ae0ask8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=b489f85f-68c4-4cd2-a0e3-53543e6bd4c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'pci_devices' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:35:20 user nova-compute[72724]:   <uuid>b489f85f-68c4-4cd2-a0e3-53543e6bd4c2</uuid>
Aug 17 16:35:20 user nova-compute[72724]:   <name>instance-00000018</name>
Aug 17 16:35:20 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:35:20 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:35:20 user nova-compute[72724]:   <metadata>
Aug 17 16:35:20 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:35:20 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:35:20 user nova-compute[72724]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1397944758</nova:name>
Aug 17 16:35:20 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:35:20</nova:creationTime>
Aug 17 16:35:20 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:35:20 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:35:20 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:35:20 user nova-compute[72724]:       <nova:owner>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:user uuid="558eaa9f170b40978f6004f1e6aff3e9">tempest-ServerRescueNegativeTestJSON-2097085369-project-member</nova:user>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:project uuid="c4767040317048ddb4479fa7c82f3384">tempest-ServerRescueNegativeTestJSON-2097085369</nova:project>
Aug 17 16:35:20 user nova-compute[72724]:       </nova:owner>
Aug 17 16:35:20 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:35:20 user nova-compute[72724]:       <nova:ports>
Aug 17 16:35:20 user nova-compute[72724]:         <nova:port uuid="8ff461e1-fcb1-4bca-b306-2c8c56e55d15">
Aug 17 16:35:20 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 16:35:20 user nova-compute[72724]:         </nova:port>
Aug 17 16:35:20 user nova-compute[72724]:       </nova:ports>
Aug 17 16:35:20 user nova-compute[72724]:     </nova:instance>
Aug 17 16:35:20 user nova-compute[72724]:   </metadata>
Aug 17 16:35:20 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:35:20 user nova-compute[72724]:     <system>
Aug 17 16:35:20 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:35:20 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:35:20 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:35:20 user nova-compute[72724]:       <entry name="serial">b489f85f-68c4-4cd2-a0e3-53543e6bd4c2</entry>
Aug 17 16:35:20 user nova-compute[72724]:       <entry name="uuid">b489f85f-68c4-4cd2-a0e3-53543e6bd4c2</entry>
Aug 17 16:35:20 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:35:20 user nova-compute[72724]:     </system>
Aug 17 16:35:20 user nova-compute[72724]:   </sysinfo>
Aug 17 16:35:20 user nova-compute[72724]:   <os>
Aug 17 16:35:20 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:35:20 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:35:20 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:35:20 user nova-compute[72724]:   </os>
Aug 17 16:35:20 user nova-compute[72724]:   <features>
Aug 17 16:35:20 user nova-compute[72724]:     <acpi/>
Aug 17 16:35:20 user nova-compute[72724]:     <apic/>
Aug 17 16:35:20 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:35:20 user nova-compute[72724]:   </features>
Aug 17 16:35:20 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:35:20 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:35:20 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:35:20 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:35:20 user nova-compute[72724]:   </clock>
Aug 17 16:35:20 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:35:20 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:35:20 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:35:20 user nova-compute[72724]:   </cpu>
Aug 17 16:35:20 user nova-compute[72724]:   <devices>
Aug 17 16:35:20 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:35:20 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:35:20 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk"/>
Aug 17 16:35:20 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:35:20 user nova-compute[72724]:     </disk>
Aug 17 16:35:20 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:35:20 user nova-compute[72724]:       <mac address="fa:16:3e:fe:b5:33"/>
Aug 17 16:35:20 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:35:20 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:35:20 user nova-compute[72724]:       <target dev="tap8ff461e1-fc"/>
Aug 17 16:35:20 user nova-compute[72724]:     </interface>
Aug 17 16:35:20 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:35:20 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/console.log" append="off"/>
Aug 17 16:35:20 user nova-compute[72724]:     </serial>
Aug 17 16:35:20 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:35:20 user nova-compute[72724]:     <video>
Aug 17 16:35:20 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:35:20 user nova-compute[72724]:     </video>
Aug 17 16:35:20 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:35:20 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:35:20 user nova-compute[72724]:     </rng>
Aug 17 16:35:20 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:35:20 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:35:20 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:35:20 user nova-compute[72724]:     </memballoon>
Aug 17 16:35:20 user nova-compute[72724]:   </devices>
Aug 17 16:35:20 user nova-compute[72724]: </domain>
Aug 17 16:35:20 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397944758',display_name='tempest-ServerRescueNegativeTestJSON-server-1397944758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397944758',id=24,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQRfAZt3m1Vbla0QpTze19m2E1AgtC8ej49fucwgZCpaFExpHOyf9jM3x5bfi79G3s3CpOU3wGg35OZn/8FI6ddnu9ythH77PTmrNaDcxjCrfDX6weaaXhmKQ22ng5nqw==',key_name='tempest-keypair-1998249459',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-ae0ask8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:35:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=b489f85f-68c4-4cd2-a0e3-53543e6bd4c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG os_vif [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ff461e1-fc, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ff461e1-fc, col_values=(('external_ids', {'iface-id': '8ff461e1-fcb1-4bca-b306-2c8c56e55d15', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:b5:33', 'vm-uuid': 'b489f85f-68c4-4cd2-a0e3-53543e6bd4c2'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:20 user nova-compute[72724]: INFO os_vif [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc')
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:35:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:fe:b5:33, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:35:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updated VIF entry in instance network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:35:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-405394fd-e604-4396-8467-f1c659bc1050 req-a17651d5-8ebf-46be-8f97-c5bf1a7b1756 service nova] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-f8324d92-1012-4e54-8c15-3c980e27eccd req-4c04a7c8-bb90-4301-9db0-2f33eb346b48 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f8324d92-1012-4e54-8c15-3c980e27eccd req-4c04a7c8-bb90-4301-9db0-2f33eb346b48 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f8324d92-1012-4e54-8c15-3c980e27eccd req-4c04a7c8-bb90-4301-9db0-2f33eb346b48 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f8324d92-1012-4e54-8c15-3c980e27eccd req-4c04a7c8-bb90-4301-9db0-2f33eb346b48 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-f8324d92-1012-4e54-8c15-3c980e27eccd req-4c04a7c8-bb90-4301-9db0-2f33eb346b48 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:35:22 user nova-compute[72724]: WARNING nova.compute.manager [req-f8324d92-1012-4e54-8c15-3c980e27eccd req-4c04a7c8-bb90-4301-9db0-2f33eb346b48 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state building and task_state spawning.
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:22 user nova-compute[72724]: INFO nova.compute.manager [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Terminating instance
Aug 17 16:35:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-e2a6732a-e232-4547-b16e-ce0d67860f22 req-c4786264-29b3-4ead-a2fe-278327af1c0d service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-vif-unplugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e2a6732a-e232-4547-b16e-ce0d67860f22 req-c4786264-29b3-4ead-a2fe-278327af1c0d service nova] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e2a6732a-e232-4547-b16e-ce0d67860f22 req-c4786264-29b3-4ead-a2fe-278327af1c0d service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e2a6732a-e232-4547-b16e-ce0d67860f22 req-c4786264-29b3-4ead-a2fe-278327af1c0d service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-e2a6732a-e232-4547-b16e-ce0d67860f22 req-c4786264-29b3-4ead-a2fe-278327af1c0d service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] No waiting events found dispatching network-vif-unplugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-e2a6732a-e232-4547-b16e-ce0d67860f22 req-c4786264-29b3-4ead-a2fe-278327af1c0d service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-vif-unplugged-487292e2-e6a2-4afd-a830-ef43137b9e97 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:35:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Instance destroyed successfully.
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lazy-loading 'resources' on Instance uuid 7e5312b5-8900-4739-a8a6-06efbcbc819c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-327932910',display_name='tempest-ServersNegativeTestJSON-server-327932910',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-327932910',id=13,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:26:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5fa57b31426d46ad8fa5351fe3ebb91e',ramdisk_id='',reservation_id='r-tluxx9p3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-566124124',owner_user_name='tempest-ServersNegativeTestJSON-566124124-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:26:32Z,user_data=None,user_id='df91a9dc8e5b49f3bf2188ab3a96b1e8',uuid=7e5312b5-8900-4739-a8a6-06efbcbc819c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converting VIF {"id": "487292e2-e6a2-4afd-a830-ef43137b9e97", "address": "fa:16:3e:43:c2:a0", "network": {"id": "06896cee-567a-46eb-96c0-3c005178f3b5", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1161141676-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5fa57b31426d46ad8fa5351fe3ebb91e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap487292e2-e6", "ovs_interfaceid": "487292e2-e6a2-4afd-a830-ef43137b9e97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG os_vif [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap487292e2-e6, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:35:23 user nova-compute[72724]: INFO os_vif [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:c2:a0,bridge_name='br-int',has_traffic_filtering=True,id=487292e2-e6a2-4afd-a830-ef43137b9e97,network=Network(06896cee-567a-46eb-96c0-3c005178f3b5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap487292e2-e6')
Aug 17 16:35:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Deleting instance files /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c_del
Aug 17 16:35:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Deletion of /opt/stack/data/nova/instances/7e5312b5-8900-4739-a8a6-06efbcbc819c_del complete
Aug 17 16:35:23 user nova-compute[72724]: INFO nova.compute.manager [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Took 0.67 seconds to destroy the instance on the hypervisor.
Aug 17 16:35:23 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:35:23 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Took 0.51 seconds to deallocate network for instance.
Aug 17 16:35:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.290s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Deleted allocations for instance 7e5312b5-8900-4739-a8a6-06efbcbc819c
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290124.2819505, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Resumed (Lifecycle Event)
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance spawned successfully.
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7a16df5b-f349-4e71-abab-3c1def4287db tempest-ServersNegativeTestJSON-566124124 tempest-ServersNegativeTestJSON-566124124-project-member] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.659s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290124.284116, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Started (Lifecycle Event)
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:35:24 user nova-compute[72724]: WARNING nova.compute.manager [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state building and task_state spawning.
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-c29a6b89-450b-4fd2-afac-9550ac2a0904 req-245f03fc-beb1-450f-82be-b071a018e98b service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-vif-deleted-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Took 6.34 seconds to spawn the instance on the hypervisor.
Aug 17 16:35:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:35:24 user nova-compute[72724]: INFO nova.compute.manager [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Took 7.05 seconds to build instance.
Aug 17 16:35:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1a6eba98-69af-45a2-94ac-59ed80f78ff6 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.141s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-a675ae7e-23a8-45f3-bd7e-aa86bbcbef10 req-52f019a1-c151-49dc-a8a2-40fe1e70db91 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received event network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:35:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a675ae7e-23a8-45f3-bd7e-aa86bbcbef10 req-52f019a1-c151-49dc-a8a2-40fe1e70db91 service nova] Acquiring lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a675ae7e-23a8-45f3-bd7e-aa86bbcbef10 req-52f019a1-c151-49dc-a8a2-40fe1e70db91 service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a675ae7e-23a8-45f3-bd7e-aa86bbcbef10 req-52f019a1-c151-49dc-a8a2-40fe1e70db91 service nova] Lock "7e5312b5-8900-4739-a8a6-06efbcbc819c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:25 user nova-compute[72724]: DEBUG nova.compute.manager [req-a675ae7e-23a8-45f3-bd7e-aa86bbcbef10 req-52f019a1-c151-49dc-a8a2-40fe1e70db91 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] No waiting events found dispatching network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:35:25 user nova-compute[72724]: WARNING nova.compute.manager [req-a675ae7e-23a8-45f3-bd7e-aa86bbcbef10 req-52f019a1-c151-49dc-a8a2-40fe1e70db91 service nova] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Received unexpected event network-vif-plugged-487292e2-e6a2-4afd-a830-ef43137b9e97 for instance with vm_state deleted and task_state None.
Aug 17 16:35:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:35:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:35:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:35:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:35:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290123.2119937, 7e5312b5-8900-4739-a8a6-06efbcbc819c => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:35:38 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] VM Stopped (Lifecycle Event)
Aug 17 16:35:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4b020bca-4fdd-479b-a79d-ce76d5db57e8 None None] [instance: 7e5312b5-8900-4739-a8a6-06efbcbc819c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:35:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:35:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:35:44 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:35:44 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:35:44 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8111MB free_disk=25.492023468017578GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:35:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:35:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.440s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:35:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:35:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:36:08 user nova-compute[72724]: INFO nova.compute.claims [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Claim successful on node user
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.383s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:36:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.policy [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c4b6bc314a140e0a5f12ecfbb43450f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2796590bb0c43479a3e82c1c4c836b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:36:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Creating image(s)
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "/opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk 1073741824" returned: 0 in 0.049s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:36:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Successfully created port: f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Cannot resize image /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.objects.instance [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'migration_context' on Instance uuid 89d711cf-d3d2-4cfa-9766-eac4523e0f47 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Ensure instance console log exists: /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Successfully updated port: f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-changed-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Refreshing instance network info cache due to event network-changed-f0ba7824-6a04-4193-87c4-597b80baab4e. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] Acquiring lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:36:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Updating instance_info_cache with network_info: [{"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Instance network_info: |[{"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] Acquired lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Refreshing network info cache for port f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Start _get_guest_xml network_info=[{"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:36:11 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:36:11 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-83258068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-83258068',id=25,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-rzp67pe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:36:09Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=89d711cf-d3d2-4cfa-9766-eac4523e0f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'pci_devices' on Instance uuid 89d711cf-d3d2-4cfa-9766-eac4523e0f47 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:36:11 user nova-compute[72724]:   <uuid>89d711cf-d3d2-4cfa-9766-eac4523e0f47</uuid>
Aug 17 16:36:11 user nova-compute[72724]:   <name>instance-00000019</name>
Aug 17 16:36:11 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:36:11 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:36:11 user nova-compute[72724]:   <metadata>
Aug 17 16:36:11 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:36:11 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:36:11 user nova-compute[72724]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-83258068</nova:name>
Aug 17 16:36:11 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:36:11</nova:creationTime>
Aug 17 16:36:11 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:36:11 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:36:11 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:36:11 user nova-compute[72724]:       <nova:owner>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:user uuid="9c4b6bc314a140e0a5f12ecfbb43450f">tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member</nova:user>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:project uuid="d2796590bb0c43479a3e82c1c4c836b0">tempest-ServerBootFromVolumeStableRescueTest-1911010508</nova:project>
Aug 17 16:36:11 user nova-compute[72724]:       </nova:owner>
Aug 17 16:36:11 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:36:11 user nova-compute[72724]:       <nova:ports>
Aug 17 16:36:11 user nova-compute[72724]:         <nova:port uuid="f0ba7824-6a04-4193-87c4-597b80baab4e">
Aug 17 16:36:11 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 16:36:11 user nova-compute[72724]:         </nova:port>
Aug 17 16:36:11 user nova-compute[72724]:       </nova:ports>
Aug 17 16:36:11 user nova-compute[72724]:     </nova:instance>
Aug 17 16:36:11 user nova-compute[72724]:   </metadata>
Aug 17 16:36:11 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:36:11 user nova-compute[72724]:     <system>
Aug 17 16:36:11 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:36:11 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:36:11 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:36:11 user nova-compute[72724]:       <entry name="serial">89d711cf-d3d2-4cfa-9766-eac4523e0f47</entry>
Aug 17 16:36:11 user nova-compute[72724]:       <entry name="uuid">89d711cf-d3d2-4cfa-9766-eac4523e0f47</entry>
Aug 17 16:36:11 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:36:11 user nova-compute[72724]:     </system>
Aug 17 16:36:11 user nova-compute[72724]:   </sysinfo>
Aug 17 16:36:11 user nova-compute[72724]:   <os>
Aug 17 16:36:11 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:36:11 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:36:11 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:36:11 user nova-compute[72724]:   </os>
Aug 17 16:36:11 user nova-compute[72724]:   <features>
Aug 17 16:36:11 user nova-compute[72724]:     <acpi/>
Aug 17 16:36:11 user nova-compute[72724]:     <apic/>
Aug 17 16:36:11 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:36:11 user nova-compute[72724]:   </features>
Aug 17 16:36:11 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:36:11 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:36:11 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:36:11 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:36:11 user nova-compute[72724]:   </clock>
Aug 17 16:36:11 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:36:11 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:36:11 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:36:11 user nova-compute[72724]:   </cpu>
Aug 17 16:36:11 user nova-compute[72724]:   <devices>
Aug 17 16:36:11 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:36:11 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:36:11 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk"/>
Aug 17 16:36:11 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:36:11 user nova-compute[72724]:     </disk>
Aug 17 16:36:11 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:36:11 user nova-compute[72724]:       <mac address="fa:16:3e:37:fd:1a"/>
Aug 17 16:36:11 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:36:11 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:36:11 user nova-compute[72724]:       <target dev="tapf0ba7824-6a"/>
Aug 17 16:36:11 user nova-compute[72724]:     </interface>
Aug 17 16:36:11 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:36:11 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/console.log" append="off"/>
Aug 17 16:36:11 user nova-compute[72724]:     </serial>
Aug 17 16:36:11 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:36:11 user nova-compute[72724]:     <video>
Aug 17 16:36:11 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:36:11 user nova-compute[72724]:     </video>
Aug 17 16:36:11 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:36:11 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:36:11 user nova-compute[72724]:     </rng>
Aug 17 16:36:11 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:36:11 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:36:11 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:36:11 user nova-compute[72724]:     </memballoon>
Aug 17 16:36:11 user nova-compute[72724]:   </devices>
Aug 17 16:36:11 user nova-compute[72724]: </domain>
Aug 17 16:36:11 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-83258068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-83258068',id=25,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-rzp67pe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:36:09Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=89d711cf-d3d2-4cfa-9766-eac4523e0f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG os_vif [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0ba7824-6a, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0ba7824-6a, col_values=(('external_ids', {'iface-id': 'f0ba7824-6a04-4193-87c4-597b80baab4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:fd:1a', 'vm-uuid': '89d711cf-d3d2-4cfa-9766-eac4523e0f47'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:11 user nova-compute[72724]: INFO os_vif [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a')
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No VIF found with MAC fa:16:3e:37:fd:1a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Updated VIF entry in instance network info cache for port f0ba7824-6a04-4193-87c4-597b80baab4e. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Updating instance_info_cache with network_info: [{"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:36:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-01a9d48f-cf82-459a-8035-c805612d8f2b req-1bdf82c0-fd4e-439d-96e5-66da03304ebc service nova] Releasing lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:36:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-df6ef633-164b-497c-96ba-e7d866bca125 req-d9fd109e-72fb-4c0a-965b-f4ec9dc0016e service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-df6ef633-164b-497c-96ba-e7d866bca125 req-d9fd109e-72fb-4c0a-965b-f4ec9dc0016e service nova] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-df6ef633-164b-497c-96ba-e7d866bca125 req-d9fd109e-72fb-4c0a-965b-f4ec9dc0016e service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-df6ef633-164b-497c-96ba-e7d866bca125 req-d9fd109e-72fb-4c0a-965b-f4ec9dc0016e service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-df6ef633-164b-497c-96ba-e7d866bca125 req-d9fd109e-72fb-4c0a-965b-f4ec9dc0016e service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] No waiting events found dispatching network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:36:13 user nova-compute[72724]: WARNING nova.compute.manager [req-df6ef633-164b-497c-96ba-e7d866bca125 req-d9fd109e-72fb-4c0a-965b-f4ec9dc0016e service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received unexpected event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e for instance with vm_state building and task_state spawning.
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290174.9172027, 89d711cf-d3d2-4cfa-9766-eac4523e0f47 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:36:14 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] VM Resumed (Lifecycle Event)
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:36:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Instance spawned successfully.
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:36:14 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:36:14 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290174.918635, 89d711cf-d3d2-4cfa-9766-eac4523e0f47 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:36:14 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] VM Started (Lifecycle Event)
Aug 17 16:36:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:36:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:36:15 user nova-compute[72724]: INFO nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 17 16:36:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:36:15 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:36:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f9e23310-7450-4de0-8bde-55882ed8e04b req-de407fb7-580a-44c3-be57-5ac5f65f9fae service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f9e23310-7450-4de0-8bde-55882ed8e04b req-de407fb7-580a-44c3-be57-5ac5f65f9fae service nova] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f9e23310-7450-4de0-8bde-55882ed8e04b req-de407fb7-580a-44c3-be57-5ac5f65f9fae service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f9e23310-7450-4de0-8bde-55882ed8e04b req-de407fb7-580a-44c3-be57-5ac5f65f9fae service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f9e23310-7450-4de0-8bde-55882ed8e04b req-de407fb7-580a-44c3-be57-5ac5f65f9fae service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] No waiting events found dispatching network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:36:15 user nova-compute[72724]: WARNING nova.compute.manager [req-f9e23310-7450-4de0-8bde-55882ed8e04b req-de407fb7-580a-44c3-be57-5ac5f65f9fae service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received unexpected event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e for instance with vm_state building and task_state spawning.
Aug 17 16:36:15 user nova-compute[72724]: INFO nova.compute.manager [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Took 6.46 seconds to build instance.
Aug 17 16:36:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-384ae768-ddfe-4c9c-89ea-7a856d905fda tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.552s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:36:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:36:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:36:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:36:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:36:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-changed-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Refreshing instance network info cache due to event network-changed-c26d4137-dcae-4c05-a416-906feff579bc. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] Acquiring lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] Acquired lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Refreshing network info cache for port c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'flavor' on Instance uuid 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:36:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Ignoring supplied device name: /dev/vdb
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:26 user nova-compute[72724]: INFO nova.compute.manager [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Attaching volume 9ad2356b-032c-46e4-a880-8a2f466be80f to /dev/vdb
Aug 17 16:36:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a1bfb2-d216-4930-82d0-308a71c79f24]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66f482c-c7cc-47aa-8083-a691c5ca4ed4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dad10b-31b6-480f-be26-c48542b46240]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8098bc-6d6a-4656-a8d7-569530f94b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:36:27 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f915f5-c363-4d1c-9e4a-38c11560bb35]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updating existing volume attachment record: 3c0d5987-9dd0-4287-a01c-78ee0cab9fe4 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG nova.network.neutron [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updated VIF entry in instance network info cache for port c26d4137-dcae-4c05-a416-906feff579bc. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG nova.network.neutron [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updating instance_info_cache with network_info: [{"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:36:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2e003843-12c4-48ed-b294-ffbd07f80bf7 req-7f5b5d55-4c60-4b4c-bf3c-4bababfd02f1 service nova] Releasing lock "refresh_cache-5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:36:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:36:35 user nova-compute[72724]: INFO nova.compute.claims [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Claim successful on node user
Aug 17 16:36:35 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:36:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:36:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:36 user nova-compute[72724]: INFO nova.virt.block_device [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Booting with volume 90245363-e382-4a2b-adf8-52bfecc898bb at /dev/vda
Aug 17 16:36:36 user nova-compute[72724]: DEBUG nova.policy [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd44441d94d244ec5a0e0b00617a3229f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f4518061f274934833bc6801498ec91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG os_brick.utils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[239f03d4-bb6d-4b4d-af25-541c101bd8fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefc8895-9fe9-481a-a82c-19027d913040]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a118a67-e222-4e13-abc2-aca9456797d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc6e550-8f18-48d0-9c42-58eca1b6e61b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:36:36 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:36:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97ee5b6-be75-404a-8154-dc8b3c5f826c]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG os_brick.utils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:36:36 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating existing volume attachment record: 772c4252-1139-4972-ab5d-d9743f260947 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:36:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Successfully created port: 2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Successfully updated port: 2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-changed-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Refreshing instance network info cache due to event network-changed-2abc8a0c-a18d-4681-969b-12954592e6ea. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] Acquiring lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance network_info: |[{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] Acquired lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:36:38 user nova-compute[72724]: DEBUG nova.network.neutron [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Refreshing network info cache for port 2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG nova.network.neutron [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updated VIF entry in instance network info cache for port 2abc8a0c-a18d-4681-969b-12954592e6ea. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG nova.network.neutron [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f3d073d-c7db-424f-b389-566d109fec79 req-283bed60-ed22-4f66-b7a5-999a4d56dfe2 service nova] Releasing lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZufpEVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:36:39 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:36:39 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:36:39 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2782fa47-916b-4607-a7fa-5a2627814ec7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:36:39 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[25376f66-517c-4d93-8411-864b5302257f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f] added
Aug 17 16:36:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[94671325-9f21-46e6-a256-bedbbf448646]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4159d558-0558-41f8-be41-af12ed0a9090]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZufpEVx {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZufpEVx" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3bb9ab-a61c-4012-bf7b-5b2d01c13b47]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZufpEVx'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c75cc99-5895-4962-914f-dbef794992ab]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b00ea9-3b5f-4c96-95f6-a91e7b7d85ee]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c85eb7-5fa0-4cc7-a7cb-9f9717c9e85d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260]
Aug 17 16:36:39 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260] successful.
Aug 17 16:36:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cbea1f-eba6-473b-b422-0e0fc164455e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ddd1edf-8715-4e24-bd33-08fd6f7b6367]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:39 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:36:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:39 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:36:39 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bc12db-5403-407e-8a83-79c984547b70]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:36:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZufpEVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23365336333356234', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365336333356234', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'flavor' on Instance uuid 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:36:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:36:40 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:36:40 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:36:40 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:36:40 user nova-compute[72724]:   <serial>9ad2356b-032c-46e4-a880-8a2f466be80f</serial>
Aug 17 16:36:40 user nova-compute[72724]: </disk>
Aug 17 16:36:40 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No VIF found with MAC fa:16:3e:cb:a6:2a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0b6c15f4-49dd-48e0-ba59-67a77b15679e tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.445s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:36:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.211s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:36:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7911MB free_disk=25.448585510253906GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:36:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:36:47 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:36:47 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:36:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:36:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:36:48 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Creating image(s)
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Ensure instance console log exists: /opt/stack/data/nova/instances/ae9f5ed4-29fe-470f-a689-64ea3d448562/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Start _get_guest_xml network_info=[{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '772c4252-1139-4972-ab5d-d9743f260947', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ae9f5ed4-29fe-470f-a689-64ea3d448562', 'attached_at': '', 'detached_at': '', 'volume_id': '90245363-e382-4a2b-adf8-52bfecc898bb', 'serial': '90245363-e382-4a2b-adf8-52bfecc898bb'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:36:48 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:36:48 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:36:48 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:36:48 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:36:48 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fcf4f0-15dd-4fc2-9a8c-e851aa122b31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:36:48 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f28512d-6d67-4cfa-84a5-6204d6fd16d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb] added
Aug 17 16:36:48 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a56574-9637-41c0-9c12-8935348dbdad]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2507d96-05cf-412e-8a51-f5018a4c7118]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laqYJwHg {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laqYJwHg" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d053fc-7a20-40aa-ba36-38c18e4979ad]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'laqYJwHg'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c57e9b5-cdab-4a97-9f1a-2b560c377d90]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7335bcae-6a4d-4271-8091-ab4e2894c6e6]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:49 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:36:49 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:49 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:36:49 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:36:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --login" returned: 0 in 1.091s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[de03b90a-6d03-465d-91b6-b30b5aeea6d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]
Aug 17 16:36:50 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.
Aug 17 16:36:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8fa9c-c128-45a1-a423-7a92a2bae722]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[353a0df8-1978-410b-8f8d-f7feb1f2928d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:50 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:36:50 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:36:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:36:50 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:36:50 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:36:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.316s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b1eeab-2e99-4cee-8028-70aafc0f16c6]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:36:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.355s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== connect_volume: return (2357ms) {'type': 'block', 'scsi_wwn': '23061653432636434', 'path': '/dev/sdd'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653432636434', 'path': '/dev/sdd'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1645846581',display_name='tempest-ServerActionsTestOtherA-server-1645846581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1645846581',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-g90fryi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=ae9f5ed4-29fe-470f-a689-64ea3d448562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_devices' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:36:51 user nova-compute[72724]:   <uuid>ae9f5ed4-29fe-470f-a689-64ea3d448562</uuid>
Aug 17 16:36:51 user nova-compute[72724]:   <name>instance-0000001a</name>
Aug 17 16:36:51 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:36:51 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:36:51 user nova-compute[72724]:   <metadata>
Aug 17 16:36:51 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:36:51 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:36:51 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherA-server-1645846581</nova:name>
Aug 17 16:36:51 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:36:48</nova:creationTime>
Aug 17 16:36:51 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:36:51 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:36:51 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:36:51 user nova-compute[72724]:       <nova:owner>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:user uuid="d44441d94d244ec5a0e0b00617a3229f">tempest-ServerActionsTestOtherA-2020786536-project-member</nova:user>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:project uuid="6f4518061f274934833bc6801498ec91">tempest-ServerActionsTestOtherA-2020786536</nova:project>
Aug 17 16:36:51 user nova-compute[72724]:       </nova:owner>
Aug 17 16:36:51 user nova-compute[72724]:       <nova:ports>
Aug 17 16:36:51 user nova-compute[72724]:         <nova:port uuid="2abc8a0c-a18d-4681-969b-12954592e6ea">
Aug 17 16:36:51 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 16:36:51 user nova-compute[72724]:         </nova:port>
Aug 17 16:36:51 user nova-compute[72724]:       </nova:ports>
Aug 17 16:36:51 user nova-compute[72724]:     </nova:instance>
Aug 17 16:36:51 user nova-compute[72724]:   </metadata>
Aug 17 16:36:51 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:36:51 user nova-compute[72724]:     <system>
Aug 17 16:36:51 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:36:51 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:36:51 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:36:51 user nova-compute[72724]:       <entry name="serial">ae9f5ed4-29fe-470f-a689-64ea3d448562</entry>
Aug 17 16:36:51 user nova-compute[72724]:       <entry name="uuid">ae9f5ed4-29fe-470f-a689-64ea3d448562</entry>
Aug 17 16:36:51 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:36:51 user nova-compute[72724]:     </system>
Aug 17 16:36:51 user nova-compute[72724]:   </sysinfo>
Aug 17 16:36:51 user nova-compute[72724]:   <os>
Aug 17 16:36:51 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:36:51 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:36:51 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:36:51 user nova-compute[72724]:   </os>
Aug 17 16:36:51 user nova-compute[72724]:   <features>
Aug 17 16:36:51 user nova-compute[72724]:     <acpi/>
Aug 17 16:36:51 user nova-compute[72724]:     <apic/>
Aug 17 16:36:51 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:36:51 user nova-compute[72724]:   </features>
Aug 17 16:36:51 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:36:51 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:36:51 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:36:51 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:36:51 user nova-compute[72724]:   </clock>
Aug 17 16:36:51 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:36:51 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:36:51 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:36:51 user nova-compute[72724]:   </cpu>
Aug 17 16:36:51 user nova-compute[72724]:   <devices>
Aug 17 16:36:51 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:36:51 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:36:51 user nova-compute[72724]:       <source dev="/dev/sdd"/>
Aug 17 16:36:51 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:36:51 user nova-compute[72724]:       <serial>90245363-e382-4a2b-adf8-52bfecc898bb</serial>
Aug 17 16:36:51 user nova-compute[72724]:     </disk>
Aug 17 16:36:51 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:36:51 user nova-compute[72724]:       <mac address="fa:16:3e:0f:52:1b"/>
Aug 17 16:36:51 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:36:51 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:36:51 user nova-compute[72724]:       <target dev="tap2abc8a0c-a1"/>
Aug 17 16:36:51 user nova-compute[72724]:     </interface>
Aug 17 16:36:51 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:36:51 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/ae9f5ed4-29fe-470f-a689-64ea3d448562/console.log" append="off"/>
Aug 17 16:36:51 user nova-compute[72724]:     </serial>
Aug 17 16:36:51 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:36:51 user nova-compute[72724]:     <video>
Aug 17 16:36:51 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:36:51 user nova-compute[72724]:     </video>
Aug 17 16:36:51 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:36:51 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:36:51 user nova-compute[72724]:     </rng>
Aug 17 16:36:51 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:36:51 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:36:51 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:36:51 user nova-compute[72724]:     </memballoon>
Aug 17 16:36:51 user nova-compute[72724]:   </devices>
Aug 17 16:36:51 user nova-compute[72724]: </domain>
Aug 17 16:36:51 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1645846581',display_name='tempest-ServerActionsTestOtherA-server-1645846581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1645846581',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-g90fryi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=ae9f5ed4-29fe-470f-a689-64ea3d448562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG os_vif [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2abc8a0c-a1, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2abc8a0c-a1, col_values=(('external_ids', {'iface-id': '2abc8a0c-a18d-4681-969b-12954592e6ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:52:1b', 'vm-uuid': 'ae9f5ed4-29fe-470f-a689-64ea3d448562'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:51 user nova-compute[72724]: INFO os_vif [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1')
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:36:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No VIF found with MAC fa:16:3e:0f:52:1b, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7f496d07-8da0-4271-87e8-cf5acbba5e3a req-bd71c243-5ff4-4d02-bd59-e43240cfcfc8 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f496d07-8da0-4271-87e8-cf5acbba5e3a req-bd71c243-5ff4-4d02-bd59-e43240cfcfc8 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f496d07-8da0-4271-87e8-cf5acbba5e3a req-bd71c243-5ff4-4d02-bd59-e43240cfcfc8 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f496d07-8da0-4271-87e8-cf5acbba5e3a req-bd71c243-5ff4-4d02-bd59-e43240cfcfc8 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7f496d07-8da0-4271-87e8-cf5acbba5e3a req-bd71c243-5ff4-4d02-bd59-e43240cfcfc8 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:36:53 user nova-compute[72724]: WARNING nova.compute.manager [req-7f496d07-8da0-4271-87e8-cf5acbba5e3a req-bd71c243-5ff4-4d02-bd59-e43240cfcfc8 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state building and task_state spawning.
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290215.008356, ae9f5ed4-29fe-470f-a689-64ea3d448562 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] VM Resumed (Lifecycle Event)
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance spawned successfully.
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290215.0101047, ae9f5ed4-29fe-470f-a689-64ea3d448562 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] VM Started (Lifecycle Event)
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f6ab64f0-cdda-46fb-afdf-419a1cb215e6 req-30de0856-ef94-493d-b7b5-cb35ec971266 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f6ab64f0-cdda-46fb-afdf-419a1cb215e6 req-30de0856-ef94-493d-b7b5-cb35ec971266 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f6ab64f0-cdda-46fb-afdf-419a1cb215e6 req-30de0856-ef94-493d-b7b5-cb35ec971266 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f6ab64f0-cdda-46fb-afdf-419a1cb215e6 req-30de0856-ef94-493d-b7b5-cb35ec971266 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f6ab64f0-cdda-46fb-afdf-419a1cb215e6 req-30de0856-ef94-493d-b7b5-cb35ec971266 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:36:55 user nova-compute[72724]: WARNING nova.compute.manager [req-f6ab64f0-cdda-46fb-afdf-419a1cb215e6 req-30de0856-ef94-493d-b7b5-cb35ec971266 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state building and task_state spawning.
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:36:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:36:55 user nova-compute[72724]: INFO nova.compute.manager [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Took 19.73 seconds to build instance.
Aug 17 16:36:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-728d70b2-d6c5-4138-a026-b65b45ebe943 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.849s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:36:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:36:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:37:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing instance network info cache due to event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.objects.instance [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'flavor' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.115s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:09 user nova-compute[72724]: INFO nova.compute.manager [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Attaching volume 25e8c140-979c-4081-ab41-79a65400d25d to /dev/vdb
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updated VIF entry in instance network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-13803018-5a32-4556-b43a-1780e5a2540f req-14a1db60-1046-4a4a-9f16-de7a05c484a3 service nova] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG os_brick.utils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aabd4e6a-a160-4e01-a11a-a4a4b8184e1d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea79f4f6-036b-4cbf-b740-3251e1e04131]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8604d2f-4ee5-4066-ae5b-fbfcdefea356]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef58d290-a0ae-4c05-8598-fd3f52739fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:37:09 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:37:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4ba681-b1ba-4927-b98a-1d07d0243ee9]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG os_brick.utils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] <== get_connector_properties: return (149ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:37:09 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating existing volume attachment record: 4820a0f3-9236-4c0b-b669-dbfb56cb085e {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:37:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXJgUkqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:37:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:37:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:37:23 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[289cf632-18b6-4596-9a37-2a97b96fdae1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:37:23 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941a327-20ed-4833-b9a1-fb9f95962c45]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d] added
Aug 17 16:37:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[249a49c2-d9d1-466c-ad27-0cbdb9aeb543]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b58954a-0e99-44d5-8533-3b299500120e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXJgUkqD {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXJgUkqD" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bcdf73-a6f6-4415-a5af-0736689fa425]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXJgUkqD'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6020132d-3567-431a-adf4-2e3a18360fbc]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f14a7d-293d-4053-8d73-16dc482b4678]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc790ebf-d5d5-45df-9a42-0c73cbecac37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260]
Aug 17 16:37:23 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260] successful.
Aug 17 16:37:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677dc03-e87f-479e-ab5b-f2ba78392939]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f7176-1792-4700-8b7c-3f443387dcc7]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:37:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:23 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:37:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[28abe4a2-be27-4cd4-a1a4-c840d5e94c7f]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXJgUkqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26232323166336364', 'path': '/dev/sde'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232323166336364', 'path': '/dev/sde'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'flavor' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:37:24 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:37:24 user nova-compute[72724]:   <source dev="/dev/sde"/>
Aug 17 16:37:24 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:37:24 user nova-compute[72724]:   <serial>25e8c140-979c-4081-ab41-79a65400d25d</serial>
Aug 17 16:37:24 user nova-compute[72724]: </disk>
Aug 17 16:37:24 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:fe:b5:33, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:37:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-907ee9fb-9d8c-4055-8e97-0f07f7b6cf89 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.300s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:25 user nova-compute[72724]: INFO nova.compute.manager [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Rescuing
Aug 17 16:37:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:37:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:37:25 user nova-compute[72724]: DEBUG nova.network.neutron [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:37:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG nova.network.neutron [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-b35418f4-e3aa-41d0-804e-9f3d8a877248 req-a1d18f7a-e6b7-4705-86a5-231ccc385d3d service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b35418f4-e3aa-41d0-804e-9f3d8a877248 req-a1d18f7a-e6b7-4705-86a5-231ccc385d3d service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b35418f4-e3aa-41d0-804e-9f3d8a877248 req-a1d18f7a-e6b7-4705-86a5-231ccc385d3d service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b35418f4-e3aa-41d0-804e-9f3d8a877248 req-a1d18f7a-e6b7-4705-86a5-231ccc385d3d service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-b35418f4-e3aa-41d0-804e-9f3d8a877248 req-a1d18f7a-e6b7-4705-86a5-231ccc385d3d service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:37:26 user nova-compute[72724]: WARNING nova.compute.manager [req-b35418f4-e3aa-41d0-804e-9f3d8a877248 req-a1d18f7a-e6b7-4705-86a5-231ccc385d3d service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state active and task_state rescuing.
Aug 17 16:37:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance destroyed successfully.
Aug 17 16:37:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Attempting rescue
Aug 17 16:37:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72724) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:37:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Creating image(s)
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'trusted_certs' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue" returned: 0 in 0.061s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'migration_context' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Start _get_guest_xml network_info=[{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:fe:b5:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'resources' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'numa_topology' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:27 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:37:27 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'vcpu_model' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397944758',display_name='tempest-ServerRescueNegativeTestJSON-server-1397944758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397944758',id=24,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQRfAZt3m1Vbla0QpTze19m2E1AgtC8ej49fucwgZCpaFExpHOyf9jM3x5bfi79G3s3CpOU3wGg35OZn/8FI6ddnu9ythH77PTmrNaDcxjCrfDX6weaaXhmKQ22ng5nqw==',key_name='tempest-keypair-1998249459',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:35:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-ae0ask8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:35:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=b489f85f-68c4-4cd2-a0e3-53543e6bd4c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:fe:b5:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "vif_mac": "fa:16:3e:fe:b5:33"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'pci_devices' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:37:27 user nova-compute[72724]:   <uuid>b489f85f-68c4-4cd2-a0e3-53543e6bd4c2</uuid>
Aug 17 16:37:27 user nova-compute[72724]:   <name>instance-00000018</name>
Aug 17 16:37:27 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:37:27 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:37:27 user nova-compute[72724]:   <metadata>
Aug 17 16:37:27 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:37:27 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:37:27 user nova-compute[72724]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1397944758</nova:name>
Aug 17 16:37:27 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:37:27</nova:creationTime>
Aug 17 16:37:27 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:37:27 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:37:27 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:37:27 user nova-compute[72724]:       <nova:owner>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:user uuid="558eaa9f170b40978f6004f1e6aff3e9">tempest-ServerRescueNegativeTestJSON-2097085369-project-member</nova:user>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:project uuid="c4767040317048ddb4479fa7c82f3384">tempest-ServerRescueNegativeTestJSON-2097085369</nova:project>
Aug 17 16:37:27 user nova-compute[72724]:       </nova:owner>
Aug 17 16:37:27 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:37:27 user nova-compute[72724]:       <nova:ports>
Aug 17 16:37:27 user nova-compute[72724]:         <nova:port uuid="8ff461e1-fcb1-4bca-b306-2c8c56e55d15">
Aug 17 16:37:27 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 16:37:27 user nova-compute[72724]:         </nova:port>
Aug 17 16:37:27 user nova-compute[72724]:       </nova:ports>
Aug 17 16:37:27 user nova-compute[72724]:     </nova:instance>
Aug 17 16:37:27 user nova-compute[72724]:   </metadata>
Aug 17 16:37:27 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:37:27 user nova-compute[72724]:     <system>
Aug 17 16:37:27 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:37:27 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:37:27 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:37:27 user nova-compute[72724]:       <entry name="serial">b489f85f-68c4-4cd2-a0e3-53543e6bd4c2</entry>
Aug 17 16:37:27 user nova-compute[72724]:       <entry name="uuid">b489f85f-68c4-4cd2-a0e3-53543e6bd4c2</entry>
Aug 17 16:37:27 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:37:27 user nova-compute[72724]:     </system>
Aug 17 16:37:27 user nova-compute[72724]:   </sysinfo>
Aug 17 16:37:27 user nova-compute[72724]:   <os>
Aug 17 16:37:27 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:37:27 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:37:27 user nova-compute[72724]:   </os>
Aug 17 16:37:27 user nova-compute[72724]:   <features>
Aug 17 16:37:27 user nova-compute[72724]:     <acpi/>
Aug 17 16:37:27 user nova-compute[72724]:     <apic/>
Aug 17 16:37:27 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:37:27 user nova-compute[72724]:   </features>
Aug 17 16:37:27 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:37:27 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:37:27 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:37:27 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:37:27 user nova-compute[72724]:   </clock>
Aug 17 16:37:27 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:37:27 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:37:27 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:37:27 user nova-compute[72724]:   </cpu>
Aug 17 16:37:27 user nova-compute[72724]:   <devices>
Aug 17 16:37:27 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:37:27 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:37:27 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue"/>
Aug 17 16:37:27 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:37:27 user nova-compute[72724]:     </disk>
Aug 17 16:37:27 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:37:27 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:37:27 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk"/>
Aug 17 16:37:27 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:37:27 user nova-compute[72724]:     </disk>
Aug 17 16:37:27 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:37:27 user nova-compute[72724]:       <mac address="fa:16:3e:fe:b5:33"/>
Aug 17 16:37:27 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:37:27 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:37:27 user nova-compute[72724]:       <target dev="tap8ff461e1-fc"/>
Aug 17 16:37:27 user nova-compute[72724]:     </interface>
Aug 17 16:37:27 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:37:27 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/console.log" append="off"/>
Aug 17 16:37:27 user nova-compute[72724]:     </serial>
Aug 17 16:37:27 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:37:27 user nova-compute[72724]:     <video>
Aug 17 16:37:27 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:37:27 user nova-compute[72724]:     </video>
Aug 17 16:37:27 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:37:27 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:37:27 user nova-compute[72724]:     </rng>
Aug 17 16:37:27 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:37:27 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:37:27 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:37:27 user nova-compute[72724]:     </memballoon>
Aug 17 16:37:27 user nova-compute[72724]:   </devices>
Aug 17 16:37:27 user nova-compute[72724]: </domain>
Aug 17 16:37:27 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:37:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance destroyed successfully.
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:37:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] No VIF found with MAC fa:16:3e:fe:b5:33, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-310ab5f6-234e-4dea-91d1-24d53d2dd483 req-66356ff2-d201-460b-88f4-48462fd30338 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-310ab5f6-234e-4dea-91d1-24d53d2dd483 req-66356ff2-d201-460b-88f4-48462fd30338 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-310ab5f6-234e-4dea-91d1-24d53d2dd483 req-66356ff2-d201-460b-88f4-48462fd30338 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-310ab5f6-234e-4dea-91d1-24d53d2dd483 req-66356ff2-d201-460b-88f4-48462fd30338 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-310ab5f6-234e-4dea-91d1-24d53d2dd483 req-66356ff2-d201-460b-88f4-48462fd30338 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:37:28 user nova-compute[72724]: WARNING nova.compute.manager [req-310ab5f6-234e-4dea-91d1-24d53d2dd483 req-66356ff2-d201-460b-88f4-48462fd30338 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state active and task_state rescuing.
Aug 17 16:37:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:30 user nova-compute[72724]: INFO nova.compute.manager [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Detaching volume 9ad2356b-032c-46e4-a880-8a2f466be80f
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:37:30 user nova-compute[72724]: WARNING nova.compute.manager [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state active and task_state rescuing.
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:37:30 user nova-compute[72724]: WARNING nova.compute.manager [req-15418347-6e8c-405f-b556-a420e33ff57e req-3440dfbe-aeae-4606-967b-bb651d67ffe6 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state active and task_state rescuing.
Aug 17 16:37:30 user nova-compute[72724]: INFO nova.virt.block_device [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Attempting to driver detach volume 9ad2356b-032c-46e4-a880-8a2f466be80f from mountpoint /dev/vdb
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Attempting to detach device vdb from instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:37:30 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:37:30 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:37:30 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:37:30 user nova-compute[72724]:   <serial>9ad2356b-032c-46e4-a880-8a2f466be80f</serial>
Aug 17 16:37:30 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:37:30 user nova-compute[72724]: </disk>
Aug 17 16:37:30 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:37:30 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully detached device vdb from instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e from the persistent domain config.
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:37:30 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:37:30 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:37:30 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:37:30 user nova-compute[72724]:   <serial>9ad2356b-032c-46e4-a880-8a2f466be80f</serial>
Aug 17 16:37:30 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:37:30 user nova-compute[72724]: </disk>
Aug 17 16:37:30 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:37:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290251.0221694, 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:37:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully detached device vdb from instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e from the live domain config.
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZufpEVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:37:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7147672-9abd-4a45-9c35-114bbcdf109f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b002a81b-5f4b-49d9-ae3d-6eeec32146e0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:31 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:37:31 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:31 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:37:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:31 user nova-compute[72724]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f (non-flash)
Aug 17 16:37:31 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:31 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:37:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e82df7f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290251.121408, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:37:31 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Resumed (Lifecycle Event)
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6253c2-09b3-4c80-ae83-43859e492010]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c40e2c65-25ba-4102-8dfc-c31368092f38 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeea657a-08f5-44e5-a71c-79dd68f8d41e]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed55b2-4174-4a2e-b275-e39de2df5fc9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:31 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290251.1236272, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:37:31 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Started (Lifecycle Event)
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3d4d9-01a0-4baa-b5ea-6df8e840f392]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcc401d-93f9-4d1d-bfb7-e1b6662f52da]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c352622-1fbd-47d6-95cf-963676b35f71]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260]
Aug 17 16:37:31 user nova-compute[72724]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f, portal: 172.16.0.220,3260] successful.
Aug 17 16:37:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0cb8e1-2dcd-48f9-b492-155842c46ea0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== disconnect_volume: return (348ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:37:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG nova.objects.instance [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'flavor' on Instance uuid 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a14b8e03-8f95-4bfc-b50f-1362f76f4f58 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.869s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.686s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:32 user nova-compute[72724]: INFO nova.compute.manager [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Terminating instance
Aug 17 16:37:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-8f5882cb-b93b-42be-ace7-02f43be4d027 req-7968d437-5744-49c2-af1a-a418d1de530b service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-vif-unplugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8f5882cb-b93b-42be-ace7-02f43be4d027 req-7968d437-5744-49c2-af1a-a418d1de530b service nova] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8f5882cb-b93b-42be-ace7-02f43be4d027 req-7968d437-5744-49c2-af1a-a418d1de530b service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8f5882cb-b93b-42be-ace7-02f43be4d027 req-7968d437-5744-49c2-af1a-a418d1de530b service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-8f5882cb-b93b-42be-ace7-02f43be4d027 req-7968d437-5744-49c2-af1a-a418d1de530b service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] No waiting events found dispatching network-vif-unplugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:37:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-8f5882cb-b93b-42be-ace7-02f43be4d027 req-7968d437-5744-49c2-af1a-a418d1de530b service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-vif-unplugged-c26d4137-dcae-4c05-a416-906feff579bc for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:37:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Instance destroyed successfully.
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'resources' on Instance uuid 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1747638424',display_name='tempest-VolumesSnapshotTestJSON-instance-1747638424',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1747638424',id=23,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA8pSZNjB/YEO5w5lfyvfOZfzHArNL5mdOCdsh3dh6xWOJMiAgXpnumjVMimIKwibPlTxTv8IUtSWHeikS1zMiqk4g8hP/Auo1wZ4/3Mgdc7cM11O+ekjd8PcwVngbuk+A==',key_name='tempest-keypair-951556577',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:34:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6683a9e4cd8a44cfb2c5b3be805e57ef',ramdisk_id='',reservation_id='r-v6kid5vk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-684431818',owner_user_name='tempest-VolumesSnapshotTestJSON-684431818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:34:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a441dd986f9a417aaa3034dca1e0c9ad',uuid=5e3de8b0-fa50-4e3a-8166-8be17ca8c35e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converting VIF {"id": "c26d4137-dcae-4c05-a416-906feff579bc", "address": "fa:16:3e:cb:a6:2a", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc26d4137-dc", "ovs_interfaceid": "c26d4137-dcae-4c05-a416-906feff579bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_vif [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc26d4137-dc, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:37:33 user nova-compute[72724]: INFO os_vif [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:a6:2a,bridge_name='br-int',has_traffic_filtering=True,id=c26d4137-dcae-4c05-a416-906feff579bc,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc26d4137-dc')
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZufpEVx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:37:33 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ad2356b-032c-46e4-a880-8a2f466be80f', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[da866941-997a-49f1-a73e-9c3b7debde21]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d07aff-6d7e-4501-bad0-5cf88f0ca2b0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:33 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:33 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:37:33 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:37:33 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:37:33 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:37:33 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c84ffa30>, {}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Disconnecting from: [] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.058s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== disconnect_volume: return (59ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:37:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Deleting instance files /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e_del
Aug 17 16:37:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Deletion of /opt/stack/data/nova/instances/5e3de8b0-fa50-4e3a-8166-8be17ca8c35e_del complete
Aug 17 16:37:33 user nova-compute[72724]: INFO nova.compute.manager [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Took 0.98 seconds to destroy the instance on the hypervisor.
Aug 17 16:37:33 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:37:33 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:37:34 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Took 1.30 seconds to deallocate network for instance.
Aug 17 16:37:34 user nova-compute[72724]: WARNING nova.volume.cinder [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Attachment 3c0d5987-9dd0-4287-a01c-78ee0cab9fe4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3c0d5987-9dd0-4287-a01c-78ee0cab9fe4. (HTTP 404) (Request-ID: req-3b1b9ea1-e6dc-41fd-8653-5080ddacb731)
Aug 17 16:37:34 user nova-compute[72724]: INFO nova.compute.manager [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Took 0.02 seconds to detach 1 volumes for instance.
Aug 17 16:37:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-64eecf00-a532-4165-b310-35786174f123 req-d5fa313c-d0e8-45c9-8bf3-8d9c1ce99f2b service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-vif-deleted-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-d4d0711f-e0c6-41bc-8917-3c5b06c07061 req-494a8d66-cd4c-42e9-9fdd-635c0013ff4c service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received event network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d4d0711f-e0c6-41bc-8917-3c5b06c07061 req-494a8d66-cd4c-42e9-9fdd-635c0013ff4c service nova] Acquiring lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d4d0711f-e0c6-41bc-8917-3c5b06c07061 req-494a8d66-cd4c-42e9-9fdd-635c0013ff4c service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d4d0711f-e0c6-41bc-8917-3c5b06c07061 req-494a8d66-cd4c-42e9-9fdd-635c0013ff4c service nova] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-d4d0711f-e0c6-41bc-8917-3c5b06c07061 req-494a8d66-cd4c-42e9-9fdd-635c0013ff4c service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] No waiting events found dispatching network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:37:34 user nova-compute[72724]: WARNING nova.compute.manager [req-d4d0711f-e0c6-41bc-8917-3c5b06c07061 req-494a8d66-cd4c-42e9-9fdd-635c0013ff4c service nova] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Received unexpected event network-vif-plugged-c26d4137-dcae-4c05-a416-906feff579bc for instance with vm_state deleted and task_state None.
Aug 17 16:37:34 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:37:35 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:35 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Deleted allocations for instance 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e
Aug 17 16:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7edc6465-956b-41a3-a0f8-ac09f5ee92c9 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "5e3de8b0-fa50-4e3a-8166-8be17ca8c35e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.926s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:37:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:37:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:37:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:37:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:37:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:37:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:37:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:37:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:37:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:37:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7943MB free_disk=25.460994720458984GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.767s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:37:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:37:48 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290253.0857089, 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:37:48 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] VM Stopped (Lifecycle Event)
Aug 17 16:37:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e6a48bee-ffb0-4075-850a-060c6acec7e1 None None] [instance: 5e3de8b0-fa50-4e3a-8166-8be17ca8c35e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:37:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:37:55 user nova-compute[72724]: INFO nova.compute.claims [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Claim successful on node user
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.368s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:37:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:37:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Creating image(s)
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "/opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "/opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "/opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:55 user nova-compute[72724]: DEBUG nova.policy [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dc28b971cb404e6b982ce84dbea72712', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00a201bdc20d433090a40728045e31d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk 1073741824" returned: 0 in 0.051s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Checking if we can resize image /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Cannot resize image /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lazy-loading 'migration_context' on Instance uuid 28d7006e-8f98-4aae-91eb-677f17b4c5fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Ensure instance console log exists: /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:37:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Successfully created port: 0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Successfully updated port: 0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "refresh_cache-28d7006e-8f98-4aae-91eb-677f17b4c5fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquired lock "refresh_cache-28d7006e-8f98-4aae-91eb-677f17b4c5fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-changed-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Refreshing instance network info cache due to event network-changed-0b7367fd-a750-4034-af3a-b9709547c9dd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] Acquiring lock "refresh_cache-28d7006e-8f98-4aae-91eb-677f17b4c5fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:37:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Updating instance_info_cache with network_info: [{"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Releasing lock "refresh_cache-28d7006e-8f98-4aae-91eb-677f17b4c5fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Instance network_info: |[{"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] Acquired lock "refresh_cache-28d7006e-8f98-4aae-91eb-677f17b4c5fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Refreshing network info cache for port 0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Start _get_guest_xml network_info=[{"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:37:59 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:37:59 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1543204303',display_name='tempest-VolumesActionsTest-instance-1543204303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1543204303',id=27,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00a201bdc20d433090a40728045e31d0',ramdisk_id='',reservation_id='r-nyubexql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1809909703',owner_user_name='tempest-VolumesActionsTest-1809909703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:37:56Z,user_data=None,user_id='dc28b971cb404e6b982ce84dbea72712',uuid=28d7006e-8f98-4aae-91eb-677f17b4c5fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Converting VIF {"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lazy-loading 'pci_devices' on Instance uuid 28d7006e-8f98-4aae-91eb-677f17b4c5fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:37:59 user nova-compute[72724]:   <uuid>28d7006e-8f98-4aae-91eb-677f17b4c5fc</uuid>
Aug 17 16:37:59 user nova-compute[72724]:   <name>instance-0000001b</name>
Aug 17 16:37:59 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:37:59 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:37:59 user nova-compute[72724]:   <metadata>
Aug 17 16:37:59 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:37:59 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:37:59 user nova-compute[72724]:       <nova:name>tempest-VolumesActionsTest-instance-1543204303</nova:name>
Aug 17 16:37:59 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:37:59</nova:creationTime>
Aug 17 16:37:59 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:37:59 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:37:59 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:37:59 user nova-compute[72724]:       <nova:owner>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:user uuid="dc28b971cb404e6b982ce84dbea72712">tempest-VolumesActionsTest-1809909703-project-member</nova:user>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:project uuid="00a201bdc20d433090a40728045e31d0">tempest-VolumesActionsTest-1809909703</nova:project>
Aug 17 16:37:59 user nova-compute[72724]:       </nova:owner>
Aug 17 16:37:59 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:37:59 user nova-compute[72724]:       <nova:ports>
Aug 17 16:37:59 user nova-compute[72724]:         <nova:port uuid="0b7367fd-a750-4034-af3a-b9709547c9dd">
Aug 17 16:37:59 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 16:37:59 user nova-compute[72724]:         </nova:port>
Aug 17 16:37:59 user nova-compute[72724]:       </nova:ports>
Aug 17 16:37:59 user nova-compute[72724]:     </nova:instance>
Aug 17 16:37:59 user nova-compute[72724]:   </metadata>
Aug 17 16:37:59 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:37:59 user nova-compute[72724]:     <system>
Aug 17 16:37:59 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:37:59 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:37:59 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:37:59 user nova-compute[72724]:       <entry name="serial">28d7006e-8f98-4aae-91eb-677f17b4c5fc</entry>
Aug 17 16:37:59 user nova-compute[72724]:       <entry name="uuid">28d7006e-8f98-4aae-91eb-677f17b4c5fc</entry>
Aug 17 16:37:59 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:37:59 user nova-compute[72724]:     </system>
Aug 17 16:37:59 user nova-compute[72724]:   </sysinfo>
Aug 17 16:37:59 user nova-compute[72724]:   <os>
Aug 17 16:37:59 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:37:59 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:37:59 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:37:59 user nova-compute[72724]:   </os>
Aug 17 16:37:59 user nova-compute[72724]:   <features>
Aug 17 16:37:59 user nova-compute[72724]:     <acpi/>
Aug 17 16:37:59 user nova-compute[72724]:     <apic/>
Aug 17 16:37:59 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:37:59 user nova-compute[72724]:   </features>
Aug 17 16:37:59 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:37:59 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:37:59 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:37:59 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:37:59 user nova-compute[72724]:   </clock>
Aug 17 16:37:59 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:37:59 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:37:59 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:37:59 user nova-compute[72724]:   </cpu>
Aug 17 16:37:59 user nova-compute[72724]:   <devices>
Aug 17 16:37:59 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:37:59 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:37:59 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk"/>
Aug 17 16:37:59 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:37:59 user nova-compute[72724]:     </disk>
Aug 17 16:37:59 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:37:59 user nova-compute[72724]:       <mac address="fa:16:3e:3a:79:28"/>
Aug 17 16:37:59 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:37:59 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:37:59 user nova-compute[72724]:       <target dev="tap0b7367fd-a7"/>
Aug 17 16:37:59 user nova-compute[72724]:     </interface>
Aug 17 16:37:59 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:37:59 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/console.log" append="off"/>
Aug 17 16:37:59 user nova-compute[72724]:     </serial>
Aug 17 16:37:59 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:37:59 user nova-compute[72724]:     <video>
Aug 17 16:37:59 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:37:59 user nova-compute[72724]:     </video>
Aug 17 16:37:59 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:37:59 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:37:59 user nova-compute[72724]:     </rng>
Aug 17 16:37:59 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:37:59 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:37:59 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:37:59 user nova-compute[72724]:     </memballoon>
Aug 17 16:37:59 user nova-compute[72724]:   </devices>
Aug 17 16:37:59 user nova-compute[72724]: </domain>
Aug 17 16:37:59 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1543204303',display_name='tempest-VolumesActionsTest-instance-1543204303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1543204303',id=27,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00a201bdc20d433090a40728045e31d0',ramdisk_id='',reservation_id='r-nyubexql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1809909703',owner_user_name='tempest-VolumesActionsTest-1809909703-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:37:56Z,user_data=None,user_id='dc28b971cb404e6b982ce84dbea72712',uuid=28d7006e-8f98-4aae-91eb-677f17b4c5fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Converting VIF {"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG os_vif [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0b7367fd-a7, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0b7367fd-a7, col_values=(('external_ids', {'iface-id': '0b7367fd-a750-4034-af3a-b9709547c9dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:79:28', 'vm-uuid': '28d7006e-8f98-4aae-91eb-677f17b4c5fc'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:37:59 user nova-compute[72724]: INFO os_vif [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7')
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] No VIF found with MAC fa:16:3e:3a:79:28, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:37:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:37:59 user nova-compute[72724]: INFO nova.compute.manager [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] instance snapshotting
Aug 17 16:37:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Beginning live snapshot process
Aug 17 16:37:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Updated VIF entry in instance network info cache for port 0b7367fd-a750-4034-af3a-b9709547c9dd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Updating instance_info_cache with network_info: [{"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4fc9e0c4-ec2d-440e-bd17-95e7bcca5c86 req-81a19635-8df7-487e-8046-1c345bb0edde service nova] Releasing lock "refresh_cache-28d7006e-8f98-4aae-91eb-677f17b4c5fc" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpucvh5nsd/52df973b00b74b8caeb9abd4371d7398.delta 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpucvh5nsd/52df973b00b74b8caeb9abd4371d7398.delta 1073741824" returned: 0 in 0.052s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 16:38:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-622b91c6-f6bb-49e1-a52e-4f9ec39c4fea req-fef0437f-e64f-4a46-a1e2-10e035b8179d service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-622b91c6-f6bb-49e1-a52e-4f9ec39c4fea req-fef0437f-e64f-4a46-a1e2-10e035b8179d service nova] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-622b91c6-f6bb-49e1-a52e-4f9ec39c4fea req-fef0437f-e64f-4a46-a1e2-10e035b8179d service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-622b91c6-f6bb-49e1-a52e-4f9ec39c4fea req-fef0437f-e64f-4a46-a1e2-10e035b8179d service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-622b91c6-f6bb-49e1-a52e-4f9ec39c4fea req-fef0437f-e64f-4a46-a1e2-10e035b8179d service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] No waiting events found dispatching network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:01 user nova-compute[72724]: WARNING nova.compute.manager [req-622b91c6-f6bb-49e1-a52e-4f9ec39c4fea req-fef0437f-e64f-4a46-a1e2-10e035b8179d service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received unexpected event network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd for instance with vm_state building and task_state spawning.
Aug 17 16:38:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:38:01 user nova-compute[72724]: INFO nova.compute.claims [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Claim successful on node user
Aug 17 16:38:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:38:01 user nova-compute[72724]: DEBUG nova.policy [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a2a3c0286d0481bb20a52426516ecac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5370ce0edee402f894294179a8731bb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:38:01 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 16:38:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:38:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Creating image(s)
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "/opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "/opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "/opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.043s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpucvh5nsd/52df973b00b74b8caeb9abd4371d7398.delta /opt/stack/data/nova/instances/snapshots/tmpucvh5nsd/52df973b00b74b8caeb9abd4371d7398 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk 1073741824" returned: 0 in 0.134s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpucvh5nsd/52df973b00b74b8caeb9abd4371d7398.delta /opt/stack/data/nova/instances/snapshots/tmpucvh5nsd/52df973b00b74b8caeb9abd4371d7398" returned: 0 in 0.676s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:02 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Snapshot extracted, beginning image upload
Aug 17 16:38:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Successfully created port: 2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Cannot resize image /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lazy-loading 'migration_context' on Instance uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Ensure instance console log exists: /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-17de21e2-fc89-46f6-af6e-33df0a1b7960 req-d3fb4695-32e0-4434-904e-5d5b227551fb service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17de21e2-fc89-46f6-af6e-33df0a1b7960 req-d3fb4695-32e0-4434-904e-5d5b227551fb service nova] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17de21e2-fc89-46f6-af6e-33df0a1b7960 req-d3fb4695-32e0-4434-904e-5d5b227551fb service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17de21e2-fc89-46f6-af6e-33df0a1b7960 req-d3fb4695-32e0-4434-904e-5d5b227551fb service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-17de21e2-fc89-46f6-af6e-33df0a1b7960 req-d3fb4695-32e0-4434-904e-5d5b227551fb service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] No waiting events found dispatching network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:03 user nova-compute[72724]: WARNING nova.compute.manager [req-17de21e2-fc89-46f6-af6e-33df0a1b7960 req-d3fb4695-32e0-4434-904e-5d5b227551fb service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received unexpected event network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd for instance with vm_state building and task_state spawning.
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Successfully updated port: 2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquired lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-changed-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Refreshing instance network info cache due to event network-changed-2c2e0b7c-ecd0-45dd-9091-209241acbd4e. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:38:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] Acquiring lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290284.0701396, 28d7006e-8f98-4aae-91eb-677f17b4c5fc => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] VM Resumed (Lifecycle Event)
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Instance spawned successfully.
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updating instance_info_cache with network_info: [{"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Releasing lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Instance network_info: |[{"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] Acquired lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Refreshing network info cache for port 2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Start _get_guest_xml network_info=[{"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:04 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:38:04 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290284.07099, 28d7006e-8f98-4aae-91eb-677f17b4c5fc => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] VM Started (Lifecycle Event)
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1490298',id=28,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzcPgQEWrd7hmAhabaGudZMlMAwNZYsQbxC6sWf08JuJw/Ih5iDwXiesgQkZjtbyXFone6KbztOlmsqYrDfsEFKxwgJRzIbGVAJx3pvP9FBgzEQURAacviogWhn2+VPcg==',key_name='tempest-keypair-1419654533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5370ce0edee402f894294179a8731bb',ramdisk_id='',reservation_id='r-nlbf4gs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-991069187',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a2a3c0286d0481bb20a52426516ecac',uuid=85dc8687-ce01-4ee3-9912-0aca2154f9e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Converting VIF {"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.objects.instance [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lazy-loading 'pci_devices' on Instance uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Took 8.35 seconds to spawn the instance on the hypervisor.
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:38:04 user nova-compute[72724]:   <uuid>85dc8687-ce01-4ee3-9912-0aca2154f9e3</uuid>
Aug 17 16:38:04 user nova-compute[72724]:   <name>instance-0000001c</name>
Aug 17 16:38:04 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:38:04 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:38:04 user nova-compute[72724]:   <metadata>
Aug 17 16:38:04 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:38:04 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:38:04 user nova-compute[72724]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361</nova:name>
Aug 17 16:38:04 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:38:04</nova:creationTime>
Aug 17 16:38:04 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:38:04 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:38:04 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:38:04 user nova-compute[72724]:       <nova:owner>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:user uuid="3a2a3c0286d0481bb20a52426516ecac">tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member</nova:user>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:project uuid="f5370ce0edee402f894294179a8731bb">tempest-TestServerVolumeAttachScenarioOldVersion-991069187</nova:project>
Aug 17 16:38:04 user nova-compute[72724]:       </nova:owner>
Aug 17 16:38:04 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:38:04 user nova-compute[72724]:       <nova:ports>
Aug 17 16:38:04 user nova-compute[72724]:         <nova:port uuid="2c2e0b7c-ecd0-45dd-9091-209241acbd4e">
Aug 17 16:38:04 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 16:38:04 user nova-compute[72724]:         </nova:port>
Aug 17 16:38:04 user nova-compute[72724]:       </nova:ports>
Aug 17 16:38:04 user nova-compute[72724]:     </nova:instance>
Aug 17 16:38:04 user nova-compute[72724]:   </metadata>
Aug 17 16:38:04 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:38:04 user nova-compute[72724]:     <system>
Aug 17 16:38:04 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:38:04 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:38:04 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:38:04 user nova-compute[72724]:       <entry name="serial">85dc8687-ce01-4ee3-9912-0aca2154f9e3</entry>
Aug 17 16:38:04 user nova-compute[72724]:       <entry name="uuid">85dc8687-ce01-4ee3-9912-0aca2154f9e3</entry>
Aug 17 16:38:04 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:38:04 user nova-compute[72724]:     </system>
Aug 17 16:38:04 user nova-compute[72724]:   </sysinfo>
Aug 17 16:38:04 user nova-compute[72724]:   <os>
Aug 17 16:38:04 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:38:04 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:38:04 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:38:04 user nova-compute[72724]:   </os>
Aug 17 16:38:04 user nova-compute[72724]:   <features>
Aug 17 16:38:04 user nova-compute[72724]:     <acpi/>
Aug 17 16:38:04 user nova-compute[72724]:     <apic/>
Aug 17 16:38:04 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:38:04 user nova-compute[72724]:   </features>
Aug 17 16:38:04 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:38:04 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:38:04 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:38:04 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:38:04 user nova-compute[72724]:   </clock>
Aug 17 16:38:04 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:38:04 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:38:04 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:38:04 user nova-compute[72724]:   </cpu>
Aug 17 16:38:04 user nova-compute[72724]:   <devices>
Aug 17 16:38:04 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:38:04 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:38:04 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk"/>
Aug 17 16:38:04 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:38:04 user nova-compute[72724]:     </disk>
Aug 17 16:38:04 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:38:04 user nova-compute[72724]:       <mac address="fa:16:3e:23:70:62"/>
Aug 17 16:38:04 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:38:04 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:38:04 user nova-compute[72724]:       <target dev="tap2c2e0b7c-ec"/>
Aug 17 16:38:04 user nova-compute[72724]:     </interface>
Aug 17 16:38:04 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:38:04 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/console.log" append="off"/>
Aug 17 16:38:04 user nova-compute[72724]:     </serial>
Aug 17 16:38:04 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:38:04 user nova-compute[72724]:     <video>
Aug 17 16:38:04 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:38:04 user nova-compute[72724]:     </video>
Aug 17 16:38:04 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:38:04 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:38:04 user nova-compute[72724]:     </rng>
Aug 17 16:38:04 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:38:04 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:38:04 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:38:04 user nova-compute[72724]:     </memballoon>
Aug 17 16:38:04 user nova-compute[72724]:   </devices>
Aug 17 16:38:04 user nova-compute[72724]: </domain>
Aug 17 16:38:04 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1490298',id=28,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzcPgQEWrd7hmAhabaGudZMlMAwNZYsQbxC6sWf08JuJw/Ih5iDwXiesgQkZjtbyXFone6KbztOlmsqYrDfsEFKxwgJRzIbGVAJx3pvP9FBgzEQURAacviogWhn2+VPcg==',key_name='tempest-keypair-1419654533',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5370ce0edee402f894294179a8731bb',ramdisk_id='',reservation_id='r-nlbf4gs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-991069187',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:38:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a2a3c0286d0481bb20a52426516ecac',uuid=85dc8687-ce01-4ee3-9912-0aca2154f9e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Converting VIF {"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG os_vif [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c2e0b7c-ec, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2c2e0b7c-ec, col_values=(('external_ids', {'iface-id': '2c2e0b7c-ecd0-45dd-9091-209241acbd4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:70:62', 'vm-uuid': '85dc8687-ce01-4ee3-9912-0aca2154f9e3'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:04 user nova-compute[72724]: INFO os_vif [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec')
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:38:04 user nova-compute[72724]: INFO nova.compute.manager [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Took 9.07 seconds to build instance.
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] No VIF found with MAC fa:16:3e:23:70:62, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e4d52ef2-5841-43ff-b777-463898062c81 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.171s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updated VIF entry in instance network info cache for port 2c2e0b7c-ecd0-45dd-9091-209241acbd4e. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updating instance_info_cache with network_info: [{"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-28446159-ccb2-4dc5-99bc-8cfe0ec07973 req-ed7ce369-a55d-4662-b5c2-5cc6360ab555 service nova] Releasing lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Snapshot image upload complete
Aug 17 16:38:05 user nova-compute[72724]: INFO nova.compute.manager [None req-c3838857-4377-4906-a0dc-b07e8313549d tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Took 5.71 seconds to snapshot the instance on the hypervisor.
Aug 17 16:38:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-255d5b26-19c3-4d1f-86c0-b420baebc324 req-21c60261-0ea6-4ae4-bd7f-ea1a3eec5d9c service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-255d5b26-19c3-4d1f-86c0-b420baebc324 req-21c60261-0ea6-4ae4-bd7f-ea1a3eec5d9c service nova] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-255d5b26-19c3-4d1f-86c0-b420baebc324 req-21c60261-0ea6-4ae4-bd7f-ea1a3eec5d9c service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-255d5b26-19c3-4d1f-86c0-b420baebc324 req-21c60261-0ea6-4ae4-bd7f-ea1a3eec5d9c service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-255d5b26-19c3-4d1f-86c0-b420baebc324 req-21c60261-0ea6-4ae4-bd7f-ea1a3eec5d9c service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] No waiting events found dispatching network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:06 user nova-compute[72724]: WARNING nova.compute.manager [req-255d5b26-19c3-4d1f-86c0-b420baebc324 req-21c60261-0ea6-4ae4-bd7f-ea1a3eec5d9c service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received unexpected event network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e for instance with vm_state building and task_state spawning.
Aug 17 16:38:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290288.0233939, 85dc8687-ce01-4ee3-9912-0aca2154f9e3 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] VM Resumed (Lifecycle Event)
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Instance spawned successfully.
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290288.026375, 85dc8687-ce01-4ee3-9912-0aca2154f9e3 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] VM Started (Lifecycle Event)
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Took 6.02 seconds to spawn the instance on the hypervisor.
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:08 user nova-compute[72724]: INFO nova.compute.manager [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Took 7.19 seconds to build instance.
Aug 17 16:38:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-95722055-cd4e-454e-ad67-7c759e6398e7 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.295s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-d37661d9-d435-4d01-be03-7300f5ef3617 req-481247d7-6e3d-46cf-ac9e-caf8a475b02f service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d37661d9-d435-4d01-be03-7300f5ef3617 req-481247d7-6e3d-46cf-ac9e-caf8a475b02f service nova] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d37661d9-d435-4d01-be03-7300f5ef3617 req-481247d7-6e3d-46cf-ac9e-caf8a475b02f service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d37661d9-d435-4d01-be03-7300f5ef3617 req-481247d7-6e3d-46cf-ac9e-caf8a475b02f service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-d37661d9-d435-4d01-be03-7300f5ef3617 req-481247d7-6e3d-46cf-ac9e-caf8a475b02f service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] No waiting events found dispatching network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:08 user nova-compute[72724]: WARNING nova.compute.manager [req-d37661d9-d435-4d01-be03-7300f5ef3617 req-481247d7-6e3d-46cf-ac9e-caf8a475b02f service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received unexpected event network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e for instance with vm_state active and task_state None.
Aug 17 16:38:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-changed-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Refreshing instance network info cache due to event network-changed-605f0625-4ba6-4c19-8562-47d6de868f1b. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:38:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:26 user nova-compute[72724]: DEBUG nova.network.neutron [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Refreshing network info cache for port 605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:38:27 user nova-compute[72724]: DEBUG nova.network.neutron [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updated VIF entry in instance network info cache for port 605f0625-4ba6-4c19-8562-47d6de868f1b. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:38:27 user nova-compute[72724]: DEBUG nova.network.neutron [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7a2c5fa1-d1e2-4e97-a36e-d66b241e5172 req-673f4f35-4857-4df6-baa1-4958660f5e37 service nova] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Stashing vm_state: active {{(pid=72724) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_requests' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:38:28 user nova-compute[72724]: INFO nova.compute.claims [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Claim successful on node user
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'resources' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'pci_devices' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:28 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating resource usage from migration 586861f3-2637-41f1-a2f9-f7e2f11695d3
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-changed-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Refreshing instance network info cache due to event network-changed-2abc8a0c-a18d-4681-969b-12954592e6ea. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] Acquiring lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] Acquired lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.network.neutron [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Refreshing network info cache for port 2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.543s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:28 user nova-compute[72724]: INFO nova.compute.manager [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Migrating
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:28 user nova-compute[72724]: INFO nova.compute.rpcapi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 17 16:38:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG nova.network.neutron [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updated VIF entry in instance network info cache for port 2abc8a0c-a18d-4681-969b-12954592e6ea. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG nova.network.neutron [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9ceb97bd-6599-474f-ba15-08e4f3c06700 req-19f622fc-c4d7-4e0e-bd50-0ce13e4e3701 service nova] Releasing lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Starting migrate_disk_and_power_off {{(pid=72724) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-3f276133-8cf0-4c21-a184-fc11d2ef38ac req-5a395c85-279a-4f7a-8341-2bdb016f6230 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3f276133-8cf0-4c21-a184-fc11d2ef38ac req-5a395c85-279a-4f7a-8341-2bdb016f6230 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3f276133-8cf0-4c21-a184-fc11d2ef38ac req-5a395c85-279a-4f7a-8341-2bdb016f6230 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3f276133-8cf0-4c21-a184-fc11d2ef38ac req-5a395c85-279a-4f7a-8341-2bdb016f6230 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-3f276133-8cf0-4c21-a184-fc11d2ef38ac req-5a395c85-279a-4f7a-8341-2bdb016f6230 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:30 user nova-compute[72724]: WARNING nova.compute.manager [req-3f276133-8cf0-4c21-a184-fc11d2ef38ac req-5a395c85-279a-4f7a-8341-2bdb016f6230 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state resize_migrating.
Aug 17 16:38:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance destroyed successfully.
Aug 17 16:38:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1645846581',display_name='tempest-ServerActionsTestOtherA-server-1645846581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1645846581',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-g90fryi0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:38:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=ae9f5ed4-29fe-470f-a689-64ea3d448562,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2abc8a0c-a1, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:38:31 user nova-compute[72724]: INFO os_vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1')
Aug 17 16:38:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:38:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[be59b75e-e986-457a-987f-2764ae9232d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef93266-a409-4525-85f2-f1901cfed385]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:38:31 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:38:31 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:38:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:38:31 user nova-compute[72724]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:38:31 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:38:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c82fff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'): ({'sdd'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Removing single pathed devices sdd {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e21179b-92c4-4c97-9527-0af206960854]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9256d0-3b45-4e71-86f8-341e39c83b09]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flushing IO for device /dev/sdd {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7903ca3e-20aa-47a9-a3b3-49f3b0d4f2ec]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[231242eb-a963-4366-9de2-757170b6a9a0]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO439a121-0ae42cd43d2744bb', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_439a121', '/dev/disk/by-id/scsi-23061653432636434') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6476602e-8524-4868-aa54-84bd553a6406]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7570cfd5-799e-45db-b18e-d49f73ca0b83]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dd941d-13cc-492f-8153-fbf15ea516c4]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]
Aug 17 16:38:31 user nova-compute[72724]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.
Aug 17 16:38:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[388630f3-c62c-4c97-a051-44e1b7cdc331]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== disconnect_volume: return (336ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:38:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Port 2abc8a0c-a18d-4681-969b-12954592e6ea binding to destination host user is already ACTIVE {{(pid=72724) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-114606a1-334d-4644-8c88-e3374364054c req-30f898d0-94c7-4e56-94c1-d362d99b2037 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-114606a1-334d-4644-8c88-e3374364054c req-30f898d0-94c7-4e56-94c1-d362d99b2037 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-114606a1-334d-4644-8c88-e3374364054c req-30f898d0-94c7-4e56-94c1-d362d99b2037 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-114606a1-334d-4644-8c88-e3374364054c req-30f898d0-94c7-4e56-94c1-d362d99b2037 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-114606a1-334d-4644-8c88-e3374364054c req-30f898d0-94c7-4e56-94c1-d362d99b2037 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:32 user nova-compute[72724]: WARNING nova.compute.manager [req-114606a1-334d-4644-8c88-e3374364054c req-30f898d0-94c7-4e56-94c1-d362d99b2037 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state resize_migrating.
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:38:32 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:38:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:38:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG os_brick.utils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99d8c7c-f2c4-4df2-adf8-6fe32e9fc8cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ceaf38-287d-4ad7-8eab-30e1d4500895]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3daf0c59-a7e4-466e-82ba-e8f70b5cb02f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d715e6c-c5da-4776-8df7-ff94e13d1fc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:38:34 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:38:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eaef746-3048-40c0-80e5-7a8108413c44]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:38:34 user nova-compute[72724]: DEBUG os_brick.utils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:38:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:38:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:38:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:38:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Starting finish_migration {{(pid=72724) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:38:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Creating image(s)
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Ensure instance console log exists: /opt/stack/data/nova/instances/ae9f5ed4-29fe-470f-a689-64ea3d448562/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Start _get_guest_xml network_info=[{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9fe2b4b9-3ea7-4c2c-b8bb-8d0c5c46f200', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ae9f5ed4-29fe-470f-a689-64ea3d448562', 'attached_at': '2023-08-17T16:38:45.000000', 'detached_at': '', 'volume_id': '90245363-e382-4a2b-adf8-52bfecc898bb', 'serial': '90245363-e382-4a2b-adf8-52bfecc898bb'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:38:45 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:38:45 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'vcpu_model' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:38:45 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:38:45 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:38:45 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e397527-07d8-4607-8fdc-e64d32ff52bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:38:45 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4692ad55-a7cf-4b49-a321-997c892fbdd8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb] added
Aug 17 16:38:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928f7f6-31ab-4016-9c21-4aa24c50cfbb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b67b471-64af-40f0-97f2-058ae835a45a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laqYJwHg {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v laqYJwHg" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2847a5c-0faa-4f90-87c0-9bd040ac4d06]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'laqYJwHg'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc9d5a34-3e6f-424f-817f-42ddee07c863]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ac8349-a961-4dd6-a674-4d10317ef8c2]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:38:45 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:38:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:38:45 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:38:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac8a7c3-efcb-4d5a-ae18-f12c891e3ea1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]
Aug 17 16:38:45 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.
Aug 17 16:38:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6cf8c4-efc3-4f1a-a444-f4c9eaaf4da2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc458c7-1f0a-4954-a6af-d3c57f25b266]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:38:45 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:38:45 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:38:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:38:45 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:38:45 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:38:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9bc135f-536b-46cb-aa0e-b76fad2830a8]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290311.1747618, ae9f5ed4-29fe-470f-a689-64ea3d448562 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:46 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] VM Stopped (Lifecycle Event)
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d7dbb18f-c8c7-485a-aad4-a67519978b93 None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d7dbb18f-c8c7-485a-aad4-a67519978b93 None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:46 user nova-compute[72724]: INFO nova.compute.manager [None req-d7dbb18f-c8c7-485a-aad4-a67519978b93 None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 16:38:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23061653432636434', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061653432636434', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:38:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:38:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7725MB free_disk=25.350364685058594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1645846581',display_name='tempest-ServerActionsTestOtherA-server-1645846581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1645846581',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-g90fryi0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=ae9f5ed4-29fe-470f-a689-64ea3d448562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:38:46 user nova-compute[72724]:   <uuid>ae9f5ed4-29fe-470f-a689-64ea3d448562</uuid>
Aug 17 16:38:46 user nova-compute[72724]:   <name>instance-0000001a</name>
Aug 17 16:38:46 user nova-compute[72724]:   <memory>2097152</memory>
Aug 17 16:38:46 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:38:46 user nova-compute[72724]:   <metadata>
Aug 17 16:38:46 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:38:46 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:38:46 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherA-server-1645846581</nova:name>
Aug 17 16:38:46 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:38:45</nova:creationTime>
Aug 17 16:38:46 user nova-compute[72724]:       <nova:flavor name="m1.small">
Aug 17 16:38:46 user nova-compute[72724]:         <nova:memory>2048</nova:memory>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:disk>20</nova:disk>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:38:46 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:38:46 user nova-compute[72724]:       <nova:owner>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:user uuid="d44441d94d244ec5a0e0b00617a3229f">tempest-ServerActionsTestOtherA-2020786536-project-member</nova:user>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:project uuid="6f4518061f274934833bc6801498ec91">tempest-ServerActionsTestOtherA-2020786536</nova:project>
Aug 17 16:38:46 user nova-compute[72724]:       </nova:owner>
Aug 17 16:38:46 user nova-compute[72724]:       <nova:ports>
Aug 17 16:38:46 user nova-compute[72724]:         <nova:port uuid="2abc8a0c-a18d-4681-969b-12954592e6ea">
Aug 17 16:38:46 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 16:38:46 user nova-compute[72724]:         </nova:port>
Aug 17 16:38:46 user nova-compute[72724]:       </nova:ports>
Aug 17 16:38:46 user nova-compute[72724]:     </nova:instance>
Aug 17 16:38:46 user nova-compute[72724]:   </metadata>
Aug 17 16:38:46 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:38:46 user nova-compute[72724]:     <system>
Aug 17 16:38:46 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:38:46 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:38:46 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:38:46 user nova-compute[72724]:       <entry name="serial">ae9f5ed4-29fe-470f-a689-64ea3d448562</entry>
Aug 17 16:38:46 user nova-compute[72724]:       <entry name="uuid">ae9f5ed4-29fe-470f-a689-64ea3d448562</entry>
Aug 17 16:38:46 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:38:46 user nova-compute[72724]:     </system>
Aug 17 16:38:46 user nova-compute[72724]:   </sysinfo>
Aug 17 16:38:46 user nova-compute[72724]:   <os>
Aug 17 16:38:46 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:38:46 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:38:46 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:38:46 user nova-compute[72724]:   </os>
Aug 17 16:38:46 user nova-compute[72724]:   <features>
Aug 17 16:38:46 user nova-compute[72724]:     <acpi/>
Aug 17 16:38:46 user nova-compute[72724]:     <apic/>
Aug 17 16:38:46 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:38:46 user nova-compute[72724]:   </features>
Aug 17 16:38:46 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:38:46 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:38:46 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:38:46 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:38:46 user nova-compute[72724]:   </clock>
Aug 17 16:38:46 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:38:46 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:38:46 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:38:46 user nova-compute[72724]:   </cpu>
Aug 17 16:38:46 user nova-compute[72724]:   <devices>
Aug 17 16:38:46 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:38:46 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:38:46 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:38:46 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:38:46 user nova-compute[72724]:       <serial>90245363-e382-4a2b-adf8-52bfecc898bb</serial>
Aug 17 16:38:46 user nova-compute[72724]:     </disk>
Aug 17 16:38:46 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:38:46 user nova-compute[72724]:       <mac address="fa:16:3e:0f:52:1b"/>
Aug 17 16:38:46 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:38:46 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:38:46 user nova-compute[72724]:       <target dev="tap2abc8a0c-a1"/>
Aug 17 16:38:46 user nova-compute[72724]:     </interface>
Aug 17 16:38:46 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:38:46 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/ae9f5ed4-29fe-470f-a689-64ea3d448562/console.log" append="off"/>
Aug 17 16:38:46 user nova-compute[72724]:     </serial>
Aug 17 16:38:46 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:38:46 user nova-compute[72724]:     <video>
Aug 17 16:38:46 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:38:46 user nova-compute[72724]:     </video>
Aug 17 16:38:46 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:38:46 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:38:46 user nova-compute[72724]:     </rng>
Aug 17 16:38:46 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:38:46 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:38:46 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:38:46 user nova-compute[72724]:     </memballoon>
Aug 17 16:38:46 user nova-compute[72724]:   </devices>
Aug 17 16:38:46 user nova-compute[72724]: </domain>
Aug 17 16:38:46 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1645846581',display_name='tempest-ServerActionsTestOtherA-server-1645846581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1645846581',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-g90fryi0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:38:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=ae9f5ed4-29fe-470f-a689-64ea3d448562,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1262100038-network", "vif_mac": "fa:16:3e:0f:52:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG os_vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2abc8a0c-a1, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2abc8a0c-a1, col_values=(('external_ids', {'iface-id': '2abc8a0c-a18d-4681-969b-12954592e6ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:52:1b', 'vm-uuid': 'ae9f5ed4-29fe-470f-a689-64ea3d448562'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:46 user nova-compute[72724]: INFO os_vif [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1')
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Applying migration context for instance ae9f5ed4-29fe-470f-a689-64ea3d448562 as it has an incoming, in-progress migration 586861f3-2637-41f1-a2f9-f7e2f11695d3. Migration status is post-migrating {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 16:38:46 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating resource usage from migration 586861f3-2637-41f1-a2f9-f7e2f11695d3
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] No VIF found with MAC fa:16:3e:0f:52:1b, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 28d7006e-8f98-4aae-91eb-677f17b4c5fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Migration 586861f3-2637-41f1-a2f9-f7e2f11695d3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:38:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:38:47 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:38:47 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:38:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:38:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-09d4092e-c021-45bb-8bde-5f846da9b63a req-2e148903-8a12-4b77-adb7-342dd98d44ce service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09d4092e-c021-45bb-8bde-5f846da9b63a req-2e148903-8a12-4b77-adb7-342dd98d44ce service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09d4092e-c021-45bb-8bde-5f846da9b63a req-2e148903-8a12-4b77-adb7-342dd98d44ce service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-09d4092e-c021-45bb-8bde-5f846da9b63a req-2e148903-8a12-4b77-adb7-342dd98d44ce service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-09d4092e-c021-45bb-8bde-5f846da9b63a req-2e148903-8a12-4b77-adb7-342dd98d44ce service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:49 user nova-compute[72724]: WARNING nova.compute.manager [req-09d4092e-c021-45bb-8bde-5f846da9b63a req-2e148903-8a12-4b77-adb7-342dd98d44ce service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state resize_finish.
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290330.3263633, ae9f5ed4-29fe-470f-a689-64ea3d448562 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] VM Resumed (Lifecycle Event)
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:38:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance running successfully.
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Failed to set time: agent not configured {{(pid=72724) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7421899b-b66d-424e-891a-1ca0704494b6 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] finish_migration finished successfully. {{(pid=72724) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290330.3277557, ae9f5ed4-29fe-470f-a689-64ea3d448562 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:38:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] VM Started (Lifecycle Event)
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:38:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:38:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 16:38:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-e23818fb-8d0c-4f5c-a467-4675394f5970 req-6c4095cd-a7fd-47b3-ad1d-c4aa67a411b6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:38:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e23818fb-8d0c-4f5c-a467-4675394f5970 req-6c4095cd-a7fd-47b3-ad1d-c4aa67a411b6 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e23818fb-8d0c-4f5c-a467-4675394f5970 req-6c4095cd-a7fd-47b3-ad1d-c4aa67a411b6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e23818fb-8d0c-4f5c-a467-4675394f5970 req-6c4095cd-a7fd-47b3-ad1d-c4aa67a411b6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-e23818fb-8d0c-4f5c-a467-4675394f5970 req-6c4095cd-a7fd-47b3-ad1d-c4aa67a411b6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:38:51 user nova-compute[72724]: WARNING nova.compute.manager [req-e23818fb-8d0c-4f5c-a467-4675394f5970 req-6c4095cd-a7fd-47b3-ad1d-c4aa67a411b6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state resized and task_state None.
Aug 17 16:38:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 333d38b1-26ec-4bd1-82d3-da202f339acb {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 89d711cf-d3d2-4cfa-9766-eac4523e0f47 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 28d7006e-8f98-4aae-91eb-677f17b4c5fc {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "00db2a89-a70b-461d-a887-ccba383edce6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.061s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "00db2a89-a70b-461d-a887-ccba383edce6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:38:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:38:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:38:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:38:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:38:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:38:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:38:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:57 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:38:57 user nova-compute[72724]: INFO nova.compute.claims [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Claim successful on node user
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:38:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.policy [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a441dd986f9a417aaa3034dca1e0c9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6683a9e4cd8a44cfb2c5b3be805e57ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:38:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Creating image(s)
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "/opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "/opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "/opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk 1073741824" returned: 0 in 0.054s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.228s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Successfully created port: d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Cannot resize image /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'migration_context' on Instance uuid c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Ensure instance console log exists: /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Successfully updated port: d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquired lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-changed-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Refreshing instance network info cache due to event network-changed-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] Acquiring lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updating instance_info_cache with network_info: [{"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Releasing lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Instance network_info: |[{"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] Acquired lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Refreshing network info cache for port d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Start _get_guest_xml network_info=[{"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:39:00 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:39:00 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2038101078',display_name='tempest-VolumesSnapshotTestJSON-instance-2038101078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2038101078',id=29,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvTkMXUlqylQmhYeJx1C55uaD7PB9JhLVVKwfJIC80uJt5/vteUN9JYEor5cWe3SB2JydvPrMGhoMuwDTGYZh4QYy+o0Aq+6D6NrVMCqLGZmd+7DYhZkDMIXUPy7dQofg==',key_name='tempest-keypair-1081736358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6683a9e4cd8a44cfb2c5b3be805e57ef',ramdisk_id='',reservation_id='r-eh0uq7it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-684431818',owner_user_name='tempest-VolumesSnapshotTestJSON-684431818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a441dd986f9a417aaa3034dca1e0c9ad',uuid=c87e81f0-8510-41b6-8d5d-e8cfef19516c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converting VIF {"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'pci_devices' on Instance uuid c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:39:00 user nova-compute[72724]:   <uuid>c87e81f0-8510-41b6-8d5d-e8cfef19516c</uuid>
Aug 17 16:39:00 user nova-compute[72724]:   <name>instance-0000001d</name>
Aug 17 16:39:00 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:39:00 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:39:00 user nova-compute[72724]:   <metadata>
Aug 17 16:39:00 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:39:00 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:39:00 user nova-compute[72724]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2038101078</nova:name>
Aug 17 16:39:00 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:39:00</nova:creationTime>
Aug 17 16:39:00 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:39:00 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:39:00 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:39:00 user nova-compute[72724]:       <nova:owner>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:user uuid="a441dd986f9a417aaa3034dca1e0c9ad">tempest-VolumesSnapshotTestJSON-684431818-project-member</nova:user>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:project uuid="6683a9e4cd8a44cfb2c5b3be805e57ef">tempest-VolumesSnapshotTestJSON-684431818</nova:project>
Aug 17 16:39:00 user nova-compute[72724]:       </nova:owner>
Aug 17 16:39:00 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:39:00 user nova-compute[72724]:       <nova:ports>
Aug 17 16:39:00 user nova-compute[72724]:         <nova:port uuid="d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047">
Aug 17 16:39:00 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 16:39:00 user nova-compute[72724]:         </nova:port>
Aug 17 16:39:00 user nova-compute[72724]:       </nova:ports>
Aug 17 16:39:00 user nova-compute[72724]:     </nova:instance>
Aug 17 16:39:00 user nova-compute[72724]:   </metadata>
Aug 17 16:39:00 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:39:00 user nova-compute[72724]:     <system>
Aug 17 16:39:00 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:39:00 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:39:00 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:39:00 user nova-compute[72724]:       <entry name="serial">c87e81f0-8510-41b6-8d5d-e8cfef19516c</entry>
Aug 17 16:39:00 user nova-compute[72724]:       <entry name="uuid">c87e81f0-8510-41b6-8d5d-e8cfef19516c</entry>
Aug 17 16:39:00 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:39:00 user nova-compute[72724]:     </system>
Aug 17 16:39:00 user nova-compute[72724]:   </sysinfo>
Aug 17 16:39:00 user nova-compute[72724]:   <os>
Aug 17 16:39:00 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:39:00 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:39:00 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:39:00 user nova-compute[72724]:   </os>
Aug 17 16:39:00 user nova-compute[72724]:   <features>
Aug 17 16:39:00 user nova-compute[72724]:     <acpi/>
Aug 17 16:39:00 user nova-compute[72724]:     <apic/>
Aug 17 16:39:00 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:39:00 user nova-compute[72724]:   </features>
Aug 17 16:39:00 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:39:00 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:39:00 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:39:00 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:39:00 user nova-compute[72724]:   </clock>
Aug 17 16:39:00 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:39:00 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:39:00 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:39:00 user nova-compute[72724]:   </cpu>
Aug 17 16:39:00 user nova-compute[72724]:   <devices>
Aug 17 16:39:00 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:39:00 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:39:00 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk"/>
Aug 17 16:39:00 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:39:00 user nova-compute[72724]:     </disk>
Aug 17 16:39:00 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:39:00 user nova-compute[72724]:       <mac address="fa:16:3e:f3:02:28"/>
Aug 17 16:39:00 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:39:00 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:39:00 user nova-compute[72724]:       <target dev="tapd0a2e8b3-0a"/>
Aug 17 16:39:00 user nova-compute[72724]:     </interface>
Aug 17 16:39:00 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:39:00 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/console.log" append="off"/>
Aug 17 16:39:00 user nova-compute[72724]:     </serial>
Aug 17 16:39:00 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:39:00 user nova-compute[72724]:     <video>
Aug 17 16:39:00 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:39:00 user nova-compute[72724]:     </video>
Aug 17 16:39:00 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:39:00 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:39:00 user nova-compute[72724]:     </rng>
Aug 17 16:39:00 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:39:00 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:39:00 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:39:00 user nova-compute[72724]:     </memballoon>
Aug 17 16:39:00 user nova-compute[72724]:   </devices>
Aug 17 16:39:00 user nova-compute[72724]: </domain>
Aug 17 16:39:00 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2038101078',display_name='tempest-VolumesSnapshotTestJSON-instance-2038101078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2038101078',id=29,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvTkMXUlqylQmhYeJx1C55uaD7PB9JhLVVKwfJIC80uJt5/vteUN9JYEor5cWe3SB2JydvPrMGhoMuwDTGYZh4QYy+o0Aq+6D6NrVMCqLGZmd+7DYhZkDMIXUPy7dQofg==',key_name='tempest-keypair-1081736358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6683a9e4cd8a44cfb2c5b3be805e57ef',ramdisk_id='',reservation_id='r-eh0uq7it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-684431818',owner_user_name='tempest-VolumesSnapshotTestJSON-684431818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a441dd986f9a417aaa3034dca1e0c9ad',uuid=c87e81f0-8510-41b6-8d5d-e8cfef19516c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converting VIF {"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG os_vif [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd0a2e8b3-0a, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd0a2e8b3-0a, col_values=(('external_ids', {'iface-id': 'd0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:02:28', 'vm-uuid': 'c87e81f0-8510-41b6-8d5d-e8cfef19516c'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:00 user nova-compute[72724]: INFO os_vif [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a')
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No VIF found with MAC fa:16:3e:f3:02:28, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updated VIF entry in instance network info cache for port d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updating instance_info_cache with network_info: [{"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e624bdcf-230c-410b-9afb-664a2093b04f req-a455aad3-cd5b-4728-a2e2-b4a08c5d5645 service nova] Releasing lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-143f70b5-9cc1-48c8-b680-17314c950176 req-04c01496-ac07-43fb-970e-58666e941e16 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-143f70b5-9cc1-48c8-b680-17314c950176 req-04c01496-ac07-43fb-970e-58666e941e16 service nova] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-143f70b5-9cc1-48c8-b680-17314c950176 req-04c01496-ac07-43fb-970e-58666e941e16 service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-143f70b5-9cc1-48c8-b680-17314c950176 req-04c01496-ac07-43fb-970e-58666e941e16 service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-143f70b5-9cc1-48c8-b680-17314c950176 req-04c01496-ac07-43fb-970e-58666e941e16 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] No waiting events found dispatching network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:02 user nova-compute[72724]: WARNING nova.compute.manager [req-143f70b5-9cc1-48c8-b680-17314c950176 req-04c01496-ac07-43fb-970e-58666e941e16 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received unexpected event network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 for instance with vm_state building and task_state spawning.
Aug 17 16:39:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290344.1213481, c87e81f0-8510-41b6-8d5d-e8cfef19516c => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] VM Resumed (Lifecycle Event)
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Instance spawned successfully.
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290344.1306906, c87e81f0-8510-41b6-8d5d-e8cfef19516c => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] VM Started (Lifecycle Event)
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Took 5.72 seconds to spawn the instance on the hypervisor.
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-50041868-b9f0-477c-b08c-59188025dc99 req-0401dba8-a5d6-4488-8ddf-585a86715ba8 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50041868-b9f0-477c-b08c-59188025dc99 req-0401dba8-a5d6-4488-8ddf-585a86715ba8 service nova] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50041868-b9f0-477c-b08c-59188025dc99 req-0401dba8-a5d6-4488-8ddf-585a86715ba8 service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50041868-b9f0-477c-b08c-59188025dc99 req-0401dba8-a5d6-4488-8ddf-585a86715ba8 service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-50041868-b9f0-477c-b08c-59188025dc99 req-0401dba8-a5d6-4488-8ddf-585a86715ba8 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] No waiting events found dispatching network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:04 user nova-compute[72724]: WARNING nova.compute.manager [req-50041868-b9f0-477c-b08c-59188025dc99 req-0401dba8-a5d6-4488-8ddf-585a86715ba8 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received unexpected event network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 for instance with vm_state building and task_state spawning.
Aug 17 16:39:04 user nova-compute[72724]: INFO nova.compute.manager [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Took 6.56 seconds to build instance.
Aug 17 16:39:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e216311e-0230-4de2-8fd4-f00b6bc7a712 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.671s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:39:07 user nova-compute[72724]: INFO nova.compute.claims [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Claim successful on node user
Aug 17 16:39:07 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:39:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:39:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:39:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:39:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:39:08 user nova-compute[72724]: INFO nova.virt.block_device [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Booting with volume-backed-image 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 at /dev/vda
Aug 17 16:39:08 user nova-compute[72724]: DEBUG nova.policy [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c4b6bc314a140e0a5f12ecfbb43450f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2796590bb0c43479a3e82c1c4c836b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:39:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Successfully created port: b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Successfully updated port: b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-changed-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Refreshing instance network info cache due to event network-changed-b68bb142-cc64-4a68-bcfa-bd96a1e1c279. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] Acquiring lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updating instance_info_cache with network_info: [{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance network_info: |[{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] Acquired lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Refreshing network info cache for port b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updated VIF entry in instance network info cache for port b68bb142-cc64-4a68-bcfa-bd96a1e1c279. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updating instance_info_cache with network_info: [{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a914afb1-5d38-4a14-8060-6b23250e0adb req-3ae69d24-f328-4854-a836-b2dab4cf6b02 service nova] Releasing lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:16 user nova-compute[72724]: INFO nova.compute.manager [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Unrescuing
Aug 17 16:39:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:39:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'flavor' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-c79da8f0-56f5-4c24-8c15-ca2281723f25 req-a8dfdf5c-89c2-42b2-9ab9-d4a0283ec5b7 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c79da8f0-56f5-4c24-8c15-ca2281723f25 req-a8dfdf5c-89c2-42b2-9ab9-d4a0283ec5b7 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c79da8f0-56f5-4c24-8c15-ca2281723f25 req-a8dfdf5c-89c2-42b2-9ab9-d4a0283ec5b7 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c79da8f0-56f5-4c24-8c15-ca2281723f25 req-a8dfdf5c-89c2-42b2-9ab9-d4a0283ec5b7 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-c79da8f0-56f5-4c24-8c15-ca2281723f25 req-a8dfdf5c-89c2-42b2-9ab9-d4a0283ec5b7 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:17 user nova-compute[72724]: WARNING nova.compute.manager [req-c79da8f0-56f5-4c24-8c15-ca2281723f25 req-a8dfdf5c-89c2-42b2-9ab9-d4a0283ec5b7 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance destroyed successfully.
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG os_brick.utils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[37283391-0799-445c-8de2-aa50367feb31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4921da9-c3fe-4ab7-a3b1-0db68e347209]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[460f4a19-b679-4f24-913b-8e1bf2afad8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78b9e16-bbfe-494e-8fe4-d1088c519cec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d846d0-7e08-4697-a61e-ab6f104c52f9]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG os_brick.utils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updating existing volume attachment record: 19a062be-50a1-4fa8-a6b0-e158f62d7645 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:19 user nova-compute[72724]: WARNING nova.compute.manager [req-fbbf3a13-8dc3-45af-8ba7-4cb626c5b1f2 req-bae092be-d208-4a8a-a704-0f53d9cb5945 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:39:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290361.3060055, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:39:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Resumed (Lifecycle Event)
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d87076d-94ae-410d-b2f5-4cba789e16d2 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:39:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290361.3084843, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:39:21 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Started (Lifecycle Event)
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-7d113f86-aeb9-4987-a1af-4b6ecbe27ccb req-986b3f36-a321-4415-9c4a-1c674653b350 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7d113f86-aeb9-4987-a1af-4b6ecbe27ccb req-986b3f36-a321-4415-9c4a-1c674653b350 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7d113f86-aeb9-4987-a1af-4b6ecbe27ccb req-986b3f36-a321-4415-9c4a-1c674653b350 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7d113f86-aeb9-4987-a1af-4b6ecbe27ccb req-986b3f36-a321-4415-9c4a-1c674653b350 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-7d113f86-aeb9-4987-a1af-4b6ecbe27ccb req-986b3f36-a321-4415-9c4a-1c674653b350 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:21 user nova-compute[72724]: WARNING nova.compute.manager [req-7d113f86-aeb9-4987-a1af-4b6ecbe27ccb req-986b3f36-a321-4415-9c4a-1c674653b350 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state active and task_state None.
Aug 17 16:39:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:39:30 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Creating image(s)
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Ensure instance console log exists: /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Start _get_guest_xml network_info=[{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '19a062be-50a1-4fa8-a6b0-e158f62d7645', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '936336a5-6ccb-4238-b886-9a00b5bf55d0', 'attached_at': '', 'detached_at': '', 'volume_id': '07e93d31-2241-4a6f-9e04-9ed310b69607', 'serial': '07e93d31-2241-4a6f-9e04-9ed310b69607'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:39:30 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:39:30 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:39:30 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:39:30 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:39:30 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b99665c-5159-447d-9314-9faceecc0f54]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:39:30 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c67c1c-f54c-4441-a6e8-b0192641690c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607] added
Aug 17 16:39:30 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9231cd7-19c1-4665-b5b4-8f3ffb2af8e8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[993e8d85-1d78-435a-9b27-1aa8a84fe218]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWUrpVQv {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWUrpVQv" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d9d671-2348-4367-810f-7faaad56cae3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWUrpVQv'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9aabe66-9ba7-4e72-b570-6c04aad0effb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af988a22-ad92-48bf-bd2f-2dc224d3899e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:39:30 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:39:30 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:39:30 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:39:30 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:39:30 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:39:30 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc8fd9-f27a-40e9-a00b-bb575ec79363]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260]
Aug 17 16:39:30 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260] successful.
Aug 17 16:39:30 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d725fe0-b9d3-49a2-8a1d-86440fda45e3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6154711f-8c21-433e-aa7e-346245c3277a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:39:31 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:39:31 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:39:31 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:39:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:39:31 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:39:31 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:39:31 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:39:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3fb365-18e6-49be-a3fb-74a91f6938e9]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:39:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26234616566353237', 'path': '/dev/sdd'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234616566353237', 'path': '/dev/sdd'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369781755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369781755',id=30,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-kmekcluf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:39:08Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=936336a5-6ccb-4238-b886-9a00b5bf55d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.objects.instance [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'pci_devices' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:39:32 user nova-compute[72724]:   <uuid>936336a5-6ccb-4238-b886-9a00b5bf55d0</uuid>
Aug 17 16:39:32 user nova-compute[72724]:   <name>instance-0000001e</name>
Aug 17 16:39:32 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:39:32 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:39:32 user nova-compute[72724]:   <metadata>
Aug 17 16:39:32 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:39:32 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:39:32 user nova-compute[72724]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-369781755</nova:name>
Aug 17 16:39:32 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:39:30</nova:creationTime>
Aug 17 16:39:32 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:39:32 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:39:32 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:39:32 user nova-compute[72724]:       <nova:owner>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:user uuid="9c4b6bc314a140e0a5f12ecfbb43450f">tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member</nova:user>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:project uuid="d2796590bb0c43479a3e82c1c4c836b0">tempest-ServerBootFromVolumeStableRescueTest-1911010508</nova:project>
Aug 17 16:39:32 user nova-compute[72724]:       </nova:owner>
Aug 17 16:39:32 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:39:32 user nova-compute[72724]:       <nova:ports>
Aug 17 16:39:32 user nova-compute[72724]:         <nova:port uuid="b68bb142-cc64-4a68-bcfa-bd96a1e1c279">
Aug 17 16:39:32 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 16:39:32 user nova-compute[72724]:         </nova:port>
Aug 17 16:39:32 user nova-compute[72724]:       </nova:ports>
Aug 17 16:39:32 user nova-compute[72724]:     </nova:instance>
Aug 17 16:39:32 user nova-compute[72724]:   </metadata>
Aug 17 16:39:32 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:39:32 user nova-compute[72724]:     <system>
Aug 17 16:39:32 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:39:32 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:39:32 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:39:32 user nova-compute[72724]:       <entry name="serial">936336a5-6ccb-4238-b886-9a00b5bf55d0</entry>
Aug 17 16:39:32 user nova-compute[72724]:       <entry name="uuid">936336a5-6ccb-4238-b886-9a00b5bf55d0</entry>
Aug 17 16:39:32 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:39:32 user nova-compute[72724]:     </system>
Aug 17 16:39:32 user nova-compute[72724]:   </sysinfo>
Aug 17 16:39:32 user nova-compute[72724]:   <os>
Aug 17 16:39:32 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:39:32 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:39:32 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:39:32 user nova-compute[72724]:   </os>
Aug 17 16:39:32 user nova-compute[72724]:   <features>
Aug 17 16:39:32 user nova-compute[72724]:     <acpi/>
Aug 17 16:39:32 user nova-compute[72724]:     <apic/>
Aug 17 16:39:32 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:39:32 user nova-compute[72724]:   </features>
Aug 17 16:39:32 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:39:32 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:39:32 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:39:32 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:39:32 user nova-compute[72724]:   </clock>
Aug 17 16:39:32 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:39:32 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:39:32 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:39:32 user nova-compute[72724]:   </cpu>
Aug 17 16:39:32 user nova-compute[72724]:   <devices>
Aug 17 16:39:32 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:39:32 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:39:32 user nova-compute[72724]:       <source dev="/dev/sdd"/>
Aug 17 16:39:32 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:39:32 user nova-compute[72724]:       <serial>07e93d31-2241-4a6f-9e04-9ed310b69607</serial>
Aug 17 16:39:32 user nova-compute[72724]:     </disk>
Aug 17 16:39:32 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:39:32 user nova-compute[72724]:       <mac address="fa:16:3e:55:4c:e8"/>
Aug 17 16:39:32 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:39:32 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:39:32 user nova-compute[72724]:       <target dev="tapb68bb142-cc"/>
Aug 17 16:39:32 user nova-compute[72724]:     </interface>
Aug 17 16:39:32 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:39:32 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/console.log" append="off"/>
Aug 17 16:39:32 user nova-compute[72724]:     </serial>
Aug 17 16:39:32 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:39:32 user nova-compute[72724]:     <video>
Aug 17 16:39:32 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:39:32 user nova-compute[72724]:     </video>
Aug 17 16:39:32 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:39:32 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:39:32 user nova-compute[72724]:     </rng>
Aug 17 16:39:32 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:39:32 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:39:32 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:39:32 user nova-compute[72724]:     </memballoon>
Aug 17 16:39:32 user nova-compute[72724]:   </devices>
Aug 17 16:39:32 user nova-compute[72724]: </domain>
Aug 17 16:39:32 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369781755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369781755',id=30,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-kmekcluf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:39:08Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=936336a5-6ccb-4238-b886-9a00b5bf55d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG os_vif [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb68bb142-cc, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb68bb142-cc, col_values=(('external_ids', {'iface-id': 'b68bb142-cc64-4a68-bcfa-bd96a1e1c279', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:4c:e8', 'vm-uuid': '936336a5-6ccb-4238-b886-9a00b5bf55d0'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:32 user nova-compute[72724]: INFO os_vif [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc')
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:39:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No VIF found with MAC fa:16:3e:55:4c:e8, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-f7ea766b-26a5-4243-9391-dd2439b600cf req-bcaf0b10-144b-46d8-94c1-da7970eafac7 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f7ea766b-26a5-4243-9391-dd2439b600cf req-bcaf0b10-144b-46d8-94c1-da7970eafac7 service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f7ea766b-26a5-4243-9391-dd2439b600cf req-bcaf0b10-144b-46d8-94c1-da7970eafac7 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f7ea766b-26a5-4243-9391-dd2439b600cf req-bcaf0b10-144b-46d8-94c1-da7970eafac7 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-f7ea766b-26a5-4243-9391-dd2439b600cf req-bcaf0b10-144b-46d8-94c1-da7970eafac7 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:33 user nova-compute[72724]: WARNING nova.compute.manager [req-f7ea766b-26a5-4243-9391-dd2439b600cf req-bcaf0b10-144b-46d8-94c1-da7970eafac7 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state building and task_state spawning.
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290375.6988297, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Resumed (Lifecycle Event)
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance spawned successfully.
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290375.7004268, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Started (Lifecycle Event)
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Took 5.11 seconds to spawn the instance on the hypervisor.
Aug 17 16:39:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:39:35 user nova-compute[72724]: INFO nova.compute.manager [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Took 28.40 seconds to build instance.
Aug 17 16:39:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-454db7b6-f0af-479b-8f15-5d1580aba623 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 28.488s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee85f796-f907-495b-a809-7b4ac3f6bf12 req-6595458f-9b61-4d85-8e2f-af288a8ae1f1 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee85f796-f907-495b-a809-7b4ac3f6bf12 req-6595458f-9b61-4d85-8e2f-af288a8ae1f1 service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee85f796-f907-495b-a809-7b4ac3f6bf12 req-6595458f-9b61-4d85-8e2f-af288a8ae1f1 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee85f796-f907-495b-a809-7b4ac3f6bf12 req-6595458f-9b61-4d85-8e2f-af288a8ae1f1 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee85f796-f907-495b-a809-7b4ac3f6bf12 req-6595458f-9b61-4d85-8e2f-af288a8ae1f1 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:36 user nova-compute[72724]: WARNING nova.compute.manager [req-ee85f796-f907-495b-a809-7b4ac3f6bf12 req-6595458f-9b61-4d85-8e2f-af288a8ae1f1 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state active and task_state None.
Aug 17 16:39:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:39:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [{"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-a0f11a53-3d01-4ad5-bc55-5df42490f7f2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:39:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:43 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.166s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:39:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:39:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:39:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7406MB free_disk=25.309795379638672GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Applying migration context for instance ae9f5ed4-29fe-470f-a689-64ea3d448562 as it has an incoming, in-progress migration 586861f3-2637-41f1-a2f9-f7e2f11695d3. Migration status is finished {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 16:39:47 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating resource usage from migration 586861f3-2637-41f1-a2f9-f7e2f11695d3
Aug 17 16:39:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 28d7006e-8f98-4aae-91eb-677f17b4c5fc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Migration 586861f3-2637-41f1-a2f9-f7e2f11695d3 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c87e81f0-8510-41b6-8d5d-e8cfef19516c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 936336a5-6ccb-4238-b886-9a00b5bf55d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:39:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.567s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:39:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:39:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-changed-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Refreshing instance network info cache due to event network-changed-2c2e0b7c-ecd0-45dd-9091-209241acbd4e. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:39:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] Acquiring lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:39:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] Acquired lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:39:51 user nova-compute[72724]: DEBUG nova.network.neutron [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Refreshing network info cache for port 2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:39:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updated VIF entry in instance network info cache for port 2c2e0b7c-ecd0-45dd-9091-209241acbd4e. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:39:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updating instance_info_cache with network_info: [{"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-861a5cee-f91f-4e35-8fc1-860b5a826994 req-49e5ea44-92f0-45c1-91de-42710a5bc5da service nova] Releasing lock "refresh_cache-85dc8687-ce01-4ee3-9912-0aca2154f9e3" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lazy-loading 'flavor' on Instance uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:57 user nova-compute[72724]: INFO nova.compute.manager [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Attaching volume 0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb to /dev/vdb
Aug 17 16:39:57 user nova-compute[72724]: DEBUG os_brick.utils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e11c0-fc73-4a1b-8c08-c84b06ab9176]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[080c1e55-484c-4b2d-8858-5418f65d341a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23845b4-a90b-4e67-9cba-5c85fd0baae5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2a3641-464b-4c50-a863-1c0725efbaf9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:39:57 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a9f8a-25e3-45ca-8093-d7261f858165]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG os_brick.utils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updating existing volume attachment record: 3e4081d3-3d87-4f74-8cf3-b61435722a0e {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:57 user nova-compute[72724]: INFO nova.compute.manager [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Terminating instance
Aug 17 16:39:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-fcf93c8c-63c0-4651-8856-6d663d987e63 req-985ca89d-258f-4f48-b9ee-612f3604e145 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-vif-unplugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fcf93c8c-63c0-4651-8856-6d663d987e63 req-985ca89d-258f-4f48-b9ee-612f3604e145 service nova] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fcf93c8c-63c0-4651-8856-6d663d987e63 req-985ca89d-258f-4f48-b9ee-612f3604e145 service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fcf93c8c-63c0-4651-8856-6d663d987e63 req-985ca89d-258f-4f48-b9ee-612f3604e145 service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-fcf93c8c-63c0-4651-8856-6d663d987e63 req-985ca89d-258f-4f48-b9ee-612f3604e145 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] No waiting events found dispatching network-vif-unplugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-fcf93c8c-63c0-4651-8856-6d663d987e63 req-985ca89d-258f-4f48-b9ee-612f3604e145 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-vif-unplugged-0b7367fd-a750-4034-af3a-b9709547c9dd for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Instance destroyed successfully.
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lazy-loading 'resources' on Instance uuid 28d7006e-8f98-4aae-91eb-677f17b4c5fc {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1543204303',display_name='tempest-VolumesActionsTest-instance-1543204303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1543204303',id=27,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:38:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00a201bdc20d433090a40728045e31d0',ramdisk_id='',reservation_id='r-nyubexql',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1809909703',owner_user_name='tempest-VolumesActionsTest-1809909703-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:38:04Z,user_data=None,user_id='dc28b971cb404e6b982ce84dbea72712',uuid=28d7006e-8f98-4aae-91eb-677f17b4c5fc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Converting VIF {"id": "0b7367fd-a750-4034-af3a-b9709547c9dd", "address": "fa:16:3e:3a:79:28", "network": {"id": "57f126e9-ddd1-418c-9226-7a66f2a2b925", "bridge": "br-int", "label": "tempest-VolumesActionsTest-142140123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00a201bdc20d433090a40728045e31d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0b7367fd-a7", "ovs_interfaceid": "0b7367fd-a750-4034-af3a-b9709547c9dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG os_vif [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0b7367fd-a7, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:39:58 user nova-compute[72724]: INFO os_vif [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:79:28,bridge_name='br-int',has_traffic_filtering=True,id=0b7367fd-a750-4034-af3a-b9709547c9dd,network=Network(57f126e9-ddd1-418c-9226-7a66f2a2b925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0b7367fd-a7')
Aug 17 16:39:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Deleting instance files /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc_del
Aug 17 16:39:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Deletion of /opt/stack/data/nova/instances/28d7006e-8f98-4aae-91eb-677f17b4c5fc_del complete
Aug 17 16:39:58 user nova-compute[72724]: INFO nova.compute.manager [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Took 0.72 seconds to destroy the instance on the hypervisor.
Aug 17 16:39:58 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:39:58 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:59 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Took 0.57 seconds to deallocate network for instance.
Aug 17 16:39:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-4346c781-bd62-448f-84b4-9c7b1d7ae13a req-f42cc56c-7f89-409b-9f3e-7431bdbb66a5 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-vif-deleted-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:39:59 user nova-compute[72724]: INFO nova.compute.manager [req-4346c781-bd62-448f-84b4-9c7b1d7ae13a req-f42cc56c-7f89-409b-9f3e-7431bdbb66a5 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Neutron deleted interface 0b7367fd-a750-4034-af3a-b9709547c9dd; detaching it from the instance and deleting it from the info cache
Aug 17 16:39:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-4346c781-bd62-448f-84b4-9c7b1d7ae13a req-f42cc56c-7f89-409b-9f3e-7431bdbb66a5 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-4346c781-bd62-448f-84b4-9c7b1d7ae13a req-f42cc56c-7f89-409b-9f3e-7431bdbb66a5 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Detach interface failed, port_id=0b7367fd-a750-4034-af3a-b9709547c9dd, reason: Instance 28d7006e-8f98-4aae-91eb-677f17b4c5fc could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:39:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.417s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:39:59 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Deleted allocations for instance 28d7006e-8f98-4aae-91eb-677f17b4c5fc
Aug 17 16:39:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cf93a38d-af7b-4bcb-b48a-8de7ffd29f17 tempest-VolumesActionsTest-1809909703 tempest-VolumesActionsTest-1809909703-project-member] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.930s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-1fd3b0b1-462c-4034-9765-be02de34ce1f req-6b8f091b-dcc8-4868-bc50-d264b05c50b2 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received event network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:40:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1fd3b0b1-462c-4034-9765-be02de34ce1f req-6b8f091b-dcc8-4868-bc50-d264b05c50b2 service nova] Acquiring lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1fd3b0b1-462c-4034-9765-be02de34ce1f req-6b8f091b-dcc8-4868-bc50-d264b05c50b2 service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1fd3b0b1-462c-4034-9765-be02de34ce1f req-6b8f091b-dcc8-4868-bc50-d264b05c50b2 service nova] Lock "28d7006e-8f98-4aae-91eb-677f17b4c5fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-1fd3b0b1-462c-4034-9765-be02de34ce1f req-6b8f091b-dcc8-4868-bc50-d264b05c50b2 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] No waiting events found dispatching network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:40:00 user nova-compute[72724]: WARNING nova.compute.manager [req-1fd3b0b1-462c-4034-9765-be02de34ce1f req-6b8f091b-dcc8-4868-bc50-d264b05c50b2 service nova] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Received unexpected event network-vif-plugged-0b7367fd-a750-4034-af3a-b9709547c9dd for instance with vm_state deleted and task_state None.
Aug 17 16:40:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSydRxOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:40:08 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:40:08 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:40:08 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a729bbee-d1ef-4432-811b-044094d9bb36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:40:08 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bf9e54-a836-4b12-b5f9-78535dbea8e8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb] added
Aug 17 16:40:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d625b222-60be-41d9-afc5-744a018929a7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[24639b7e-e201-4aa8-8db0-be270e757706]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSydRxOQ {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WSydRxOQ" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2acc58-ac64-47ca-bde0-6d503cab0c49]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WSydRxOQ'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa43134-9896-445d-972d-0d61cdb31ea3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0375e77c-be9a-443c-a86b-5b40c4e49dea]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:40:08 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:40:08 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:40:08 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:40:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:40:08 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:40:08 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:40:08 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:40:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba9cfd9-3b41-4e4d-ab82-5496a124b4b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260]
Aug 17 16:40:08 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260] successful.
Aug 17 16:40:08 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[debe316a-7883-4583-8510-cd5dc82b05fa]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb797bf0-8539-4e91-b269-fe68fdb2b36e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb (non-flash)
Aug 17 16:40:09 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:40:09 user nova-compute[72724]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb (non-flash)
Aug 17 16:40:09 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] HCTL ('37', '-', '-', 0) found on session 32 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78039723-9910-4a95-80ff-0a61c7a64473]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:09 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Searching for a device in session 32 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSydRxOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26666643334363439', 'path': '/dev/sdf'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666643334363439', 'path': '/dev/sdf'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lazy-loading 'flavor' on Instance uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:40:10 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:40:10 user nova-compute[72724]:   <source dev="/dev/sdf"/>
Aug 17 16:40:10 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:40:10 user nova-compute[72724]:   <serial>0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb</serial>
Aug 17 16:40:10 user nova-compute[72724]: </disk>
Aug 17 16:40:10 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] No VIF found with MAC fa:16:3e:23:70:62, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:40:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8bfaa2f3-ec57-4b66-839b-407f5d633d5b tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.324s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:12 user nova-compute[72724]: INFO nova.compute.manager [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Detaching volume 0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb
Aug 17 16:40:12 user nova-compute[72724]: INFO nova.virt.block_device [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Attempting to driver detach volume 0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb from mountpoint /dev/vdb
Aug 17 16:40:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Attempting to detach device vdb from instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:40:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:40:12 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:40:12 user nova-compute[72724]:   <source dev="/dev/sdf"/>
Aug 17 16:40:12 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:40:12 user nova-compute[72724]:   <serial>0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb</serial>
Aug 17 16:40:12 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:40:12 user nova-compute[72724]: </disk>
Aug 17 16:40:12 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:40:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Successfully detached device vdb from instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 from the persistent domain config.
Aug 17 16:40:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:40:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:40:12 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:40:12 user nova-compute[72724]:   <source dev="/dev/sdf"/>
Aug 17 16:40:12 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:40:12 user nova-compute[72724]:   <serial>0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb</serial>
Aug 17 16:40:12 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:40:12 user nova-compute[72724]: </disk>
Aug 17 16:40:12 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290398.3727202, 28d7006e-8f98-4aae-91eb-677f17b4c5fc => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:40:13 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] VM Stopped (Lifecycle Event)
Aug 17 16:40:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-397b4fd3-cb42-4986-854e-e47334c74138 None None] [instance: 28d7006e-8f98-4aae-91eb-677f17b4c5fc] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290413.4157302, 85dc8687-ce01-4ee3-9912-0aca2154f9e3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:40:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Successfully detached device vdb from instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 from the live domain config.
Aug 17 16:40:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WSydRxOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:40:13 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[27864ba4-d214-40ca-a00c-b4420569a863]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c4f60b-4e54-4418-9e48-066a4b6bd146]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb (non-flash)
Aug 17 16:40:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:40:13 user nova-compute[72724]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb (non-flash)
Aug 17 16:40:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c82fe8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb'): ({'sdf'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Removing single pathed devices sdf {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2fd8209-595e-4281-8c76-fcb01b851950]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec53fc4-b521-4015-8352-aafdb00fdd68]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Flushing IO for device /dev/sdf {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[beae01bf-57a0-4bdf-a340-6c6ef8a469f2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.045s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad68f16-05d6-4257-a522-1a82230092bc]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] SCSI volumes sdf have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdd16a5-6c14-41ab-96a7-880e4d90e059]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca00216-3abb-4360-bde9-46416916349c]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260]
Aug 17 16:40:13 user nova-compute[72724]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb, portal: 172.16.0.220,3260] successful.
Aug 17 16:40:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0da2b7f9-41ec-4ce5-b41f-75ccd069b9eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a3498-74dd-452d-aaee-f5f05b58facb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] <== disconnect_volume: return (331ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:40:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:40:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lazy-loading 'flavor' on Instance uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:40:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0a558870-a909-40fc-a4db-0fb7ecb99fe9 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.759s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Going to confirm migration 1 {{(pid=72724) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquired lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'info_cache' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [{"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Releasing lock "refresh_cache-ae9f5ed4-29fe-470f-a689-64ea3d448562" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'migration_context' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:19 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:40:19 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:40:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.492s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:19 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Deleted allocation for migration 586861f3-2637-41f1-a2f9-f7e2f11695d3
Aug 17 16:40:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-68354334-d254-4af0-b8bb-f72c477130d2 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.432s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:40:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:40:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [{"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f09067a8-3cf3-4fe7-aa75-78348da59adb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:40:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:48 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:40:48 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7485MB free_disk=25.33572006225586GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c87e81f0-8510-41b6-8d5d-e8cfef19516c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 936336a5-6ccb-4238-b886-9a00b5bf55d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:40:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-changed-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Refreshing instance network info cache due to event network-changed-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] Acquiring lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] Acquired lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.network.neutron [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Refreshing network info cache for port d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.517s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'flavor' on Instance uuid c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:40:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Ignoring supplied device name: /dev/vdb
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:49 user nova-compute[72724]: INFO nova.compute.manager [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Attaching volume de069bd2-29ff-4a7c-adf3-5bf83c223fd8 to /dev/vdb
Aug 17 16:40:49 user nova-compute[72724]: DEBUG os_brick.utils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e1c9dc-8bce-4458-81ed-eacab30becb1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.network.neutron [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updated VIF entry in instance network info cache for port d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.network.neutron [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updating instance_info_cache with network_info: [{"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7c526b-8ac8-4ded-81aa-ee896e21f7a4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ec88b277-6b21-4158-a50e-0355329f10cd req-e8e70310-0dbe-4b31-9ee3-728d31052383 service nova] Releasing lock "refresh_cache-c87e81f0-8510-41b6-8d5d-e8cfef19516c" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0e364d-efc9-4f1e-961d-888a7522a373]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6d0d96-7d14-4242-9b38-f09cb0764b34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:40:49 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:40:49 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f59124-e05e-4da5-bf11-a62e9f7f8df0]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG os_brick.utils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:40:49 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updating existing volume attachment record: 1f652072-570e-47b8-a43f-6068c7590464 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:40:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:40:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:40:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:58 user nova-compute[72724]: INFO nova.compute.manager [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Rescuing
Aug 17 16:40:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:40:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:40:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:40:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updating instance_info_cache with network_info: [{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:40:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0aac4883-60a8-4864-b91d-7492d13961e3 req-f9af5e67-c1b1-4172-9498-aca5901fefbe service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0aac4883-60a8-4864-b91d-7492d13961e3 req-f9af5e67-c1b1-4172-9498-aca5901fefbe service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0aac4883-60a8-4864-b91d-7492d13961e3 req-f9af5e67-c1b1-4172-9498-aca5901fefbe service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0aac4883-60a8-4864-b91d-7492d13961e3 req-f9af5e67-c1b1-4172-9498-aca5901fefbe service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-0aac4883-60a8-4864-b91d-7492d13961e3 req-f9af5e67-c1b1-4172-9498-aca5901fefbe service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:40:59 user nova-compute[72724]: WARNING nova.compute.manager [req-0aac4883-60a8-4864-b91d-7492d13961e3 req-f9af5e67-c1b1-4172-9498-aca5901fefbe service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state active and task_state rescuing.
Aug 17 16:40:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:40:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance destroyed successfully.
Aug 17 16:40:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Attempting a stable device rescue
Aug 17 16:40:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72724) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:40:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Creating image(s)
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "/opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "/opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'trusted_certs' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "7f5769c37d6f636295af51e8b6572129d80b984b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:40:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "7f5769c37d6f636295af51e8b6572129d80b984b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.part --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG nova.virt.images [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] 3fc83be1-b1e6-4022-9a4d-798a1143c945 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.part /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-b3a4ce31-5e67-4bb8-8ec3-fd1937bef400 req-f323469b-b5bc-4212-a313-732b1d714a5b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b3a4ce31-5e67-4bb8-8ec3-fd1937bef400 req-f323469b-b5bc-4212-a313-732b1d714a5b service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b3a4ce31-5e67-4bb8-8ec3-fd1937bef400 req-f323469b-b5bc-4212-a313-732b1d714a5b service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b3a4ce31-5e67-4bb8-8ec3-fd1937bef400 req-f323469b-b5bc-4212-a313-732b1d714a5b service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-b3a4ce31-5e67-4bb8-8ec3-fd1937bef400 req-f323469b-b5bc-4212-a313-732b1d714a5b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:41:01 user nova-compute[72724]: WARNING nova.compute.manager [req-b3a4ce31-5e67-4bb8-8ec3-fd1937bef400 req-f323469b-b5bc-4212-a313-732b1d714a5b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state active and task_state rescuing.
Aug 17 16:41:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVugSzwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:41:01 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:41:01 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:41:01 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2818f3-e981-4697-ab1c-c47a50077ff7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:41:01 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d87225-01a6-498b-8614-049aa003b0f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8] added
Aug 17 16:41:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06653cc5-1cfd-43db-b835-19c45ccc9d89]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.079s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ab2090-e364-45dd-bad5-80c7b48fd5f7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVugSzwT {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVugSzwT" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3e3097-6c75-46dd-9145-4b5594fab084]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVugSzwT'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.part /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.converted" returned: 0 in 0.640s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9df2099-c713-4f9b-bda2-b4a866599a15]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bca6031-11ff-49f2-acde-3b397b386307]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c08d724-c091-409f-ae97-655e0784ebc5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260]
Aug 17 16:41:01 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260] successful.
Aug 17 16:41:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d5b814-7e1d-476b-9a08-95eba140b507]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "7f5769c37d6f636295af51e8b6572129d80b984b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.170s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "7f5769c37d6f636295af51e8b6572129d80b984b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "7f5769c37d6f636295af51e8b6572129d80b984b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ca944-a994-49a1-a0e5-bfd7ac516f2a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:41:01 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.493s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:41:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcec008-4dfd-406c-9ffe-ad92c58969ae]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVugSzwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b,backing_fmt=raw /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b,backing_fmt=raw /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue" returned: 0 in 0.107s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "7f5769c37d6f636295af51e8b6572129d80b984b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'migration_context' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Start _get_guest_xml network_info=[{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "vif_mac": "fa:16:3e:55:4c:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3fc83be1-b1e6-4022-9a4d-798a1143c945', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '19a062be-50a1-4fa8-a6b0-e158f62d7645', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '936336a5-6ccb-4238-b886-9a00b5bf55d0', 'attached_at': '', 'detached_at': '', 'volume_id': '07e93d31-2241-4a6f-9e04-9ed310b69607', 'serial': '07e93d31-2241-4a6f-9e04-9ed310b69607'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'resources' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'numa_topology' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:02 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:41:02 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'vcpu_model' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:41:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:41:02 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:41:02 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.534s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== connect_volume: return (1537ms) {'type': 'block', 'scsi_wwn': '23939376563336639', 'path': '/dev/sdf'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939376563336639', 'path': '/dev/sdf'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.665s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:41:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:41:03 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'flavor' on Instance uuid c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e27a13d-141d-4dc4-b7df-ce89ce3df110]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = lWUrpVQv\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 17 16:41:03 user nova-compute[72724]: node.name = iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607
Aug 17 16:41:03 user nova-compute[72724]: node.tpgt = -1
Aug 17 16:41:03 user nova-compute[72724]: node.startup = automatic
Aug 17 16:41:03 user nova-compute[72724]: node.leading_login = No
Aug 17 16:41:03 user nova-compute[72724]: iface.iscsi_ifacename = default
Aug 17 16:41:03 user nova-compute[72724]: iface.net_ifacename = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.ipaddress = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.prefix_len = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.hwaddress = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.transport_name = tcp
Aug 17 16:41:03 user nova-compute[72724]: iface.initiatorname = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.vlan_id = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.vlan_priority = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.vlan_state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.iface_num = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.mtu = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.port = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.bootproto = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.subnet_mask = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.gateway = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_alt_client_id_state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_alt_client_id = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_dns = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_learn_iqn = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_req_vendor_id_state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_vendor_id_state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_vendor_id = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.dhcp_slp_da = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.fragmentation = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.gratuitous_arp = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.incoming_forwarding = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.tos_state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.tos = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.ttl = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.delayed_ack = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.tcp_nagle = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.tcp_wsf_state = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.tcp_wsf = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.tcp_timer_scale = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.tcp_timestamp = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.redirect = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.def_task_mgmt_timeout = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.header_digest = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.data_digest = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.immediate_data = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.initial_r2t = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.data_seq_inorder = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.data_pdu_inorder = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.erl = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.max_receive_data_len = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.first_burst_len = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.max_outstanding_r2t = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.max_burst_len = 0
Aug 17 16:41:03 user nova-compute[72724]: iface.chap_auth = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.bidi_chap = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.strict_login_compliance = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.discovery_auth = <empty>
Aug 17 16:41:03 user nova-compute[72724]: iface.discovery_logout = <empty>
Aug 17 16:41:03 user nova-compute[72724]: node.discovery_address = <empty>
Aug 17 16:41:03 user nova-compute[72724]: node.discovery_port = 0
Aug 17 16:41:03 user nova-compute[72724]: node.discovery_type = static
Aug 17 16:41:03 user nova-compute[72724]: node.session.initial_cmdsn = 0
Aug 17 16:41:03 user nova-compute[72724]: node.session.initial_login_retry_max = 8
Aug 17 16:41:03 user nova-compute[72724]: node.session.xmit_thread_priority = -20
Aug 17 16:41:03 user nova-compute[72724]: node.session.cmds_max = 128
Aug 17 16:41:03 user nova-compute[72724]: node.session.queue_depth = 32
Aug 17 16:41:03 user nova-compute[72724]: node.session.nr_sessions = 1
Aug 17 16:41:03 user nova-compute[72724]: node.session.auth.authmethod = CHAP
Aug 17 16:41:03 user nova-compute[72724]: node.session.auth.username = lWUrpVQv
Aug 17 16:41:03 user nova-compute[72724]: node.session.auth.password = ***
Aug 17 16:41:03 user nova-compute[72724]: node.session.auth.username_in = <empty>
Aug 17 16:41:03 user nova-compute[72724]: node.session.auth.password_in = <empty>
Aug 17 16:41:03 user nova-compute[72724]: node.session.auth.chap_algs = MD5
Aug 17 16:41:03 user nova-compute[72724]: node.session.timeo.replacement_timeout = 120
Aug 17 16:41:03 user nova-compute[72724]: node.session.err_timeo.abort_timeout = 15
Aug 17 16:41:03 user nova-compute[72724]: node.session.err_timeo.lu_reset_timeout = 30
Aug 17 16:41:03 user nova-compute[72724]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 17 16:41:03 user nova-compute[72724]: node.session.err_timeo.host_reset_timeout = 60
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.FastAbort = Yes
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.InitialR2T = No
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.ImmediateData = Yes
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.FirstBurstLength = 262144
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.MaxBurstLength = 16776192
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.DefaultTime2Retain = 0
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.DefaultTime2Wait = 2
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.MaxConnections = 1
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 17 16:41:03 user nova-compute[72724]: node.session.iscsi.ERL = 0
Aug 17 16:41:03 user nova-compute[72724]: node.session.scan = manual
Aug 17 16:41:03 user nova-compute[72724]: node.session.reopen_max = 0
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].address = 172.16.0.220
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].port = 3260
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].startup = manual
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].tcp.window_size = 524288
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].tcp.type_of_service = 0
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].timeo.logout_timeout = 15
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].timeo.login_timeout = 15
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].timeo.auth_timeout = 45
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].timeo.noop_out_interval = 5
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].timeo.noop_out_timeout = 5
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].iscsi.HeaderDigest = None
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].iscsi.DataDigest = None
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].iscsi.IFMarker = No
Aug 17 16:41:03 user nova-compute[72724]: node.conn[0].iscsi.OFMarker = No
Aug 17 16:41:03 user nova-compute[72724]: # END RECORD
Aug 17 16:41:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:41:03 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:41:03 user nova-compute[72724]:   <source dev="/dev/sdf"/>
Aug 17 16:41:03 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:41:03 user nova-compute[72724]:   <serial>de069bd2-29ff-4a7c-adf3-5bf83c223fd8</serial>
Aug 17 16:41:03 user nova-compute[72724]: </disk>
Aug 17 16:41:03 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[61be2c16-719a-4139-b92b-b8d8ce064e77]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[67398158-2c5a-44ef-a517-053e4bbf8602]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWUrpVQv {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lWUrpVQv" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1cc5ee7-0290-40dc-8596-ba995f4a1d7f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lWUrpVQv'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[456d7af5-8f9d-4ea5-a86d-674ba3c8b92c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e210a5f7-6b00-4b12-9a03-d02d2df7709a]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:41:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:03 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:41:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.190s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] HCTL ('35', '0', '0', 0) found on session 31 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b684c3fb-7bb0-482d-bf45-b1b56d80ebcb]: (4, ('0 0 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Searching for a device in session 31 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.226s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== connect_volume: return (892ms) {'type': 'block', 'scsi_wwn': '26234616566353237', 'path': '/dev/sdd'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26234616566353237', 'path': '/dev/sdd'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369781755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369781755',id=30,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:39:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-kmekcluf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:39:36Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=936336a5-6ccb-4238-b886-9a00b5bf55d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "vif_mac": "fa:16:3e:55:4c:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "vif_mac": "fa:16:3e:55:4c:e8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'pci_devices' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:41:03 user nova-compute[72724]:   <uuid>936336a5-6ccb-4238-b886-9a00b5bf55d0</uuid>
Aug 17 16:41:03 user nova-compute[72724]:   <name>instance-0000001e</name>
Aug 17 16:41:03 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:41:03 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:41:03 user nova-compute[72724]:   <metadata>
Aug 17 16:41:03 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:41:03 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:41:03 user nova-compute[72724]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-369781755</nova:name>
Aug 17 16:41:03 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:41:02</nova:creationTime>
Aug 17 16:41:03 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:41:03 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:41:03 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:41:03 user nova-compute[72724]:       <nova:owner>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:user uuid="9c4b6bc314a140e0a5f12ecfbb43450f">tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member</nova:user>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:project uuid="d2796590bb0c43479a3e82c1c4c836b0">tempest-ServerBootFromVolumeStableRescueTest-1911010508</nova:project>
Aug 17 16:41:03 user nova-compute[72724]:       </nova:owner>
Aug 17 16:41:03 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:41:03 user nova-compute[72724]:       <nova:ports>
Aug 17 16:41:03 user nova-compute[72724]:         <nova:port uuid="b68bb142-cc64-4a68-bcfa-bd96a1e1c279">
Aug 17 16:41:03 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 16:41:03 user nova-compute[72724]:         </nova:port>
Aug 17 16:41:03 user nova-compute[72724]:       </nova:ports>
Aug 17 16:41:03 user nova-compute[72724]:     </nova:instance>
Aug 17 16:41:03 user nova-compute[72724]:   </metadata>
Aug 17 16:41:03 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:41:03 user nova-compute[72724]:     <system>
Aug 17 16:41:03 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:41:03 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:41:03 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:41:03 user nova-compute[72724]:       <entry name="serial">936336a5-6ccb-4238-b886-9a00b5bf55d0</entry>
Aug 17 16:41:03 user nova-compute[72724]:       <entry name="uuid">936336a5-6ccb-4238-b886-9a00b5bf55d0</entry>
Aug 17 16:41:03 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:41:03 user nova-compute[72724]:     </system>
Aug 17 16:41:03 user nova-compute[72724]:   </sysinfo>
Aug 17 16:41:03 user nova-compute[72724]:   <os>
Aug 17 16:41:03 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:41:03 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:41:03 user nova-compute[72724]:   </os>
Aug 17 16:41:03 user nova-compute[72724]:   <features>
Aug 17 16:41:03 user nova-compute[72724]:     <acpi/>
Aug 17 16:41:03 user nova-compute[72724]:     <apic/>
Aug 17 16:41:03 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:41:03 user nova-compute[72724]:   </features>
Aug 17 16:41:03 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:41:03 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:41:03 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:41:03 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:41:03 user nova-compute[72724]:   </clock>
Aug 17 16:41:03 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:41:03 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:41:03 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:41:03 user nova-compute[72724]:   </cpu>
Aug 17 16:41:03 user nova-compute[72724]:   <devices>
Aug 17 16:41:03 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:41:03 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:41:03 user nova-compute[72724]:       <source dev="/dev/sdd"/>
Aug 17 16:41:03 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:41:03 user nova-compute[72724]:       <serial>07e93d31-2241-4a6f-9e04-9ed310b69607</serial>
Aug 17 16:41:03 user nova-compute[72724]:     </disk>
Aug 17 16:41:03 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:41:03 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:41:03 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue"/>
Aug 17 16:41:03 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:41:03 user nova-compute[72724]:       <boot order="1"/>
Aug 17 16:41:03 user nova-compute[72724]:     </disk>
Aug 17 16:41:03 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:41:03 user nova-compute[72724]:       <mac address="fa:16:3e:55:4c:e8"/>
Aug 17 16:41:03 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:41:03 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:41:03 user nova-compute[72724]:       <target dev="tapb68bb142-cc"/>
Aug 17 16:41:03 user nova-compute[72724]:     </interface>
Aug 17 16:41:03 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:41:03 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/console.log" append="off"/>
Aug 17 16:41:03 user nova-compute[72724]:     </serial>
Aug 17 16:41:03 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:41:03 user nova-compute[72724]:     <video>
Aug 17 16:41:03 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:41:03 user nova-compute[72724]:     </video>
Aug 17 16:41:03 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:41:03 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:41:03 user nova-compute[72724]:     </rng>
Aug 17 16:41:03 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:41:03 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:41:03 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:41:03 user nova-compute[72724]:     </memballoon>
Aug 17 16:41:03 user nova-compute[72724]:   </devices>
Aug 17 16:41:03 user nova-compute[72724]: </domain>
Aug 17 16:41:03 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:41:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance destroyed successfully.
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] No VIF found with MAC fa:16:3e:55:4c:e8, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] No VIF found with MAC fa:16:3e:f3:02:28, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-886677a3-d308-4302-89b5-ad8ecfd8a9f7 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.007s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-21824ecf-b99f-4345-a48d-4396a1389102 req-d60c06e2-e6df-459e-9e3b-452af654fc4c service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-21824ecf-b99f-4345-a48d-4396a1389102 req-d60c06e2-e6df-459e-9e3b-452af654fc4c service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-21824ecf-b99f-4345-a48d-4396a1389102 req-d60c06e2-e6df-459e-9e3b-452af654fc4c service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-21824ecf-b99f-4345-a48d-4396a1389102 req-d60c06e2-e6df-459e-9e3b-452af654fc4c service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-21824ecf-b99f-4345-a48d-4396a1389102 req-d60c06e2-e6df-459e-9e3b-452af654fc4c service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:41:05 user nova-compute[72724]: WARNING nova.compute.manager [req-21824ecf-b99f-4345-a48d-4396a1389102 req-d60c06e2-e6df-459e-9e3b-452af654fc4c service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state active and task_state rescuing.
Aug 17 16:41:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 936336a5-6ccb-4238-b886-9a00b5bf55d0 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290467.0489244, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:41:07 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Resumed (Lifecycle Event)
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e5496ec9-750e-4e94-91d0-4a0c4d7474fd tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:41:07 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290467.0503542, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:41:07 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Started (Lifecycle Event)
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-58350655-1b73-4096-99d8-063e3df279aa req-8df8e0b1-6d7a-4802-a83b-92b544ff1c16 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-58350655-1b73-4096-99d8-063e3df279aa req-8df8e0b1-6d7a-4802-a83b-92b544ff1c16 service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-58350655-1b73-4096-99d8-063e3df279aa req-8df8e0b1-6d7a-4802-a83b-92b544ff1c16 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-58350655-1b73-4096-99d8-063e3df279aa req-8df8e0b1-6d7a-4802-a83b-92b544ff1c16 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-58350655-1b73-4096-99d8-063e3df279aa req-8df8e0b1-6d7a-4802-a83b-92b544ff1c16 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:41:07 user nova-compute[72724]: WARNING nova.compute.manager [req-58350655-1b73-4096-99d8-063e3df279aa req-8df8e0b1-6d7a-4802-a83b-92b544ff1c16 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state rescued and task_state None.
Aug 17 16:41:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing instance network info cache due to event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:41:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:41:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:41:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updated VIF entry in instance network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-be11900a-d520-4f8c-905e-0c2f1b81c0b1 req-72f2a699-0d76-4c3a-9f3a-6fe9487ce105 service nova] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:09 user nova-compute[72724]: INFO nova.compute.manager [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Detaching volume 25e8c140-979c-4081-ab41-79a65400d25d
Aug 17 16:41:09 user nova-compute[72724]: INFO nova.virt.block_device [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Attempting to driver detach volume 25e8c140-979c-4081-ab41-79a65400d25d from mountpoint /dev/vdb
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Attempting to detach device vdb from instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:41:09 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:41:09 user nova-compute[72724]:   <source dev="/dev/sde"/>
Aug 17 16:41:09 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:41:09 user nova-compute[72724]:   <serial>25e8c140-979c-4081-ab41-79a65400d25d</serial>
Aug 17 16:41:09 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:41:09 user nova-compute[72724]: </disk>
Aug 17 16:41:09 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:41:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully detached device vdb from instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 from the persistent domain config.
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:41:09 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:41:09 user nova-compute[72724]:   <source dev="/dev/sde"/>
Aug 17 16:41:09 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:41:09 user nova-compute[72724]:   <serial>25e8c140-979c-4081-ab41-79a65400d25d</serial>
Aug 17 16:41:09 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:41:09 user nova-compute[72724]: </disk>
Aug 17 16:41:09 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:09 user nova-compute[72724]: INFO nova.compute.manager [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Terminating instance
Aug 17 16:41:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290470.1112561, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully detached device vdb from instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 from the live domain config.
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXJgUkqD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:41:10 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c40efc8-0ee0-435a-8fa7-8fe91667e787]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9e50753-5e0b-463c-8d9a-0667f91f9b53]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:41:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:41:10 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:41:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c854f9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d'): ({'sde'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Removing single pathed devices sde {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c668ae67-536e-4a44-a004-dd5bc7762820]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde39cc6-6a50-47c9-9f49-9fa7155d664d]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Flushing IO for device /dev/sde {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9be599-3af9-4528-b75f-2af780f24a52]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.072s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd2afc7-32ba-44fd-8bf8-d49a1749bae4]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] SCSI volumes sde have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9b53e33-9e46-4140-a9cc-60503ced3852 req-19dbdfbd-705b-46bf-9c11-a026da162f48 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-vif-unplugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9b53e33-9e46-4140-a9cc-60503ced3852 req-19dbdfbd-705b-46bf-9c11-a026da162f48 service nova] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9b53e33-9e46-4140-a9cc-60503ced3852 req-19dbdfbd-705b-46bf-9c11-a026da162f48 service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9b53e33-9e46-4140-a9cc-60503ced3852 req-19dbdfbd-705b-46bf-9c11-a026da162f48 service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9b53e33-9e46-4140-a9cc-60503ced3852 req-19dbdfbd-705b-46bf-9c11-a026da162f48 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] No waiting events found dispatching network-vif-unplugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9b53e33-9e46-4140-a9cc-60503ced3852 req-19dbdfbd-705b-46bf-9c11-a026da162f48 service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-vif-unplugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54f2c90-8787-4435-a93a-894cd0c2ad68]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5f0e24-b09f-4313-8e28-531494c454ea]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260]
Aug 17 16:41:10 user nova-compute[72724]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d, portal: 172.16.0.220,3260] successful.
Aug 17 16:41:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:25e8c140-979c-4081-ab41-79a65400d25d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af5e2fb-cc45-45ef-98db-ee5aef134d84]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.416s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] <== disconnect_volume: return (417ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:41:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Instance destroyed successfully.
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.objects.instance [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lazy-loading 'resources' on Instance uuid 85dc8687-ce01-4ee3-9912-0aca2154f9e3 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:38:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1490298361',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1490298',id=28,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNzcPgQEWrd7hmAhabaGudZMlMAwNZYsQbxC6sWf08JuJw/Ih5iDwXiesgQkZjtbyXFone6KbztOlmsqYrDfsEFKxwgJRzIbGVAJx3pvP9FBgzEQURAacviogWhn2+VPcg==',key_name='tempest-keypair-1419654533',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:38:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5370ce0edee402f894294179a8731bb',ramdisk_id='',reservation_id='r-nlbf4gs1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-991069187',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:38:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3a2a3c0286d0481bb20a52426516ecac',uuid=85dc8687-ce01-4ee3-9912-0aca2154f9e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Converting VIF {"id": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "address": "fa:16:3e:23:70:62", "network": {"id": "8b036a83-8bd0-42d6-8fb9-8b76826458c6", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-481899627-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5370ce0edee402f894294179a8731bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2e0b7c-ec", "ovs_interfaceid": "2c2e0b7c-ecd0-45dd-9091-209241acbd4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG os_vif [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c2e0b7c-ec, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:10 user nova-compute[72724]: INFO os_vif [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:70:62,bridge_name='br-int',has_traffic_filtering=True,id=2c2e0b7c-ecd0-45dd-9091-209241acbd4e,network=Network(8b036a83-8bd0-42d6-8fb9-8b76826458c6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2e0b7c-ec')
Aug 17 16:41:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Deleting instance files /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3_del
Aug 17 16:41:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Deletion of /opt/stack/data/nova/instances/85dc8687-ce01-4ee3-9912-0aca2154f9e3_del complete
Aug 17 16:41:10 user nova-compute[72724]: INFO nova.compute.manager [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing instance network info cache due to event network-changed-8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:41:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] Acquiring lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] Acquired lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Refreshing network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'flavor' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-98a289db-0d52-45c1-8b3b-bcd8c05bef0b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.015s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updated VIF entry in instance network info cache for port 8ff461e1-fcb1-4bca-b306-2c8c56e55d15. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [{"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-604b2b3a-d532-4859-806d-7427ed5bafe5 req-438b063b-4748-4cfb-9e60-d6676c63f050 service nova] Releasing lock "refresh_cache-b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:41:11 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Took 0.97 seconds to deallocate network for instance.
Aug 17 16:41:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-47b03b67-95fb-4ee8-9375-a4eb1aee550f req-da92a3c0-699c-4395-b8f9-8a11c3d065da service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-vif-deleted-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:12 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Deleted allocations for instance 85dc8687-ce01-4ee3-9912-0aca2154f9e3
Aug 17 16:41:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-15c80f85-102b-4772-9f10-12dde7d13d90 tempest-TestServerVolumeAttachScenarioOldVersion-991069187 tempest-TestServerVolumeAttachScenarioOldVersion-991069187-project-member] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.486s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-8a819048-ea20-4607-8824-bcd365c76afc req-ffbd5e47-fcf8-4201-8924-7082af1bbf7e service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received event network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8a819048-ea20-4607-8824-bcd365c76afc req-ffbd5e47-fcf8-4201-8924-7082af1bbf7e service nova] Acquiring lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8a819048-ea20-4607-8824-bcd365c76afc req-ffbd5e47-fcf8-4201-8924-7082af1bbf7e service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8a819048-ea20-4607-8824-bcd365c76afc req-ffbd5e47-fcf8-4201-8924-7082af1bbf7e service nova] Lock "85dc8687-ce01-4ee3-9912-0aca2154f9e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-8a819048-ea20-4607-8824-bcd365c76afc req-ffbd5e47-fcf8-4201-8924-7082af1bbf7e service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] No waiting events found dispatching network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:41:12 user nova-compute[72724]: WARNING nova.compute.manager [req-8a819048-ea20-4607-8824-bcd365c76afc req-ffbd5e47-fcf8-4201-8924-7082af1bbf7e service nova] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Received unexpected event network-vif-plugged-2c2e0b7c-ecd0-45dd-9091-209241acbd4e for instance with vm_state deleted and task_state None.
Aug 17 16:41:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:25 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290470.750589, 85dc8687-ce01-4ee3-9912-0aca2154f9e3 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:41:25 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] VM Stopped (Lifecycle Event)
Aug 17 16:41:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6f5f08a7-8a3f-4320-a594-88b0d2c2462b None None] [instance: 85dc8687-ce01-4ee3-9912-0aca2154f9e3] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:41:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:41:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:41:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:41:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [{"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-59a5dee3-bf14-4196-a8da-c9ea471c0752" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:41:44 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:41:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:41:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:41:48 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:41:48 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7717MB free_disk=25.264862060546875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c87e81f0-8510-41b6-8d5d-e8cfef19516c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 936336a5-6ccb-4238-b886-9a00b5bf55d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:41:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:41:49 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:41:49 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:41:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:41:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:41:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:41:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:41:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:41:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:41:59 user nova-compute[72724]: INFO nova.compute.manager [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Terminating instance
Aug 17 16:41:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:41:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-55a24bad-c865-4570-b361-95dd00d813a5 req-67b72923-0c48-480b-b5ba-15923d8e147b service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-55a24bad-c865-4570-b361-95dd00d813a5 req-67b72923-0c48-480b-b5ba-15923d8e147b service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-55a24bad-c865-4570-b361-95dd00d813a5 req-67b72923-0c48-480b-b5ba-15923d8e147b service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-55a24bad-c865-4570-b361-95dd00d813a5 req-67b72923-0c48-480b-b5ba-15923d8e147b service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-55a24bad-c865-4570-b361-95dd00d813a5 req-67b72923-0c48-480b-b5ba-15923d8e147b service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-55a24bad-c865-4570-b361-95dd00d813a5 req-67b72923-0c48-480b-b5ba-15923d8e147b service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-unplugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Instance destroyed successfully.
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'resources' on Instance uuid b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1397944758',display_name='tempest-ServerRescueNegativeTestJSON-server-1397944758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1397944758',id=24,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQRfAZt3m1Vbla0QpTze19m2E1AgtC8ej49fucwgZCpaFExpHOyf9jM3x5bfi79G3s3CpOU3wGg35OZn/8FI6ddnu9ythH77PTmrNaDcxjCrfDX6weaaXhmKQ22ng5nqw==',key_name='tempest-keypair-1998249459',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:37:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-ae0ask8o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=b489f85f-68c4-4cd2-a0e3-53543e6bd4c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "address": "fa:16:3e:fe:b5:33", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ff461e1-fc", "ovs_interfaceid": "8ff461e1-fcb1-4bca-b306-2c8c56e55d15", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG os_vif [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ff461e1-fc, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:42:00 user nova-compute[72724]: INFO os_vif [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:b5:33,bridge_name='br-int',has_traffic_filtering=True,id=8ff461e1-fcb1-4bca-b306-2c8c56e55d15,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ff461e1-fc')
Aug 17 16:42:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Deleting instance files /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2_del
Aug 17 16:42:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Deletion of /opt/stack/data/nova/instances/b489f85f-68c4-4cd2-a0e3-53543e6bd4c2_del complete
Aug 17 16:42:00 user nova-compute[72724]: INFO nova.compute.manager [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 16:42:00 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:42:00 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:42:01 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:42:01 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Took 0.84 seconds to deallocate network for instance.
Aug 17 16:42:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:42:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:42:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:02 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Deleted allocations for instance b489f85f-68c4-4cd2-a0e3-53543e6bd4c2
Aug 17 16:42:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-da77507f-b928-44fb-9965-87ffb4d7d185 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.263s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] Acquiring lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] Lock "b489f85f-68c4-4cd2-a0e3-53543e6bd4c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] No waiting events found dispatching network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:02 user nova-compute[72724]: WARNING nova.compute.manager [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received unexpected event network-vif-plugged-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 for instance with vm_state deleted and task_state None.
Aug 17 16:42:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-c564f0a0-8dc1-45b5-b043-24539e17a1dc req-2a41e8a1-a4bf-4448-bba9-997986357a06 service nova] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Received event network-vif-deleted-8ff461e1-fcb1-4bca-b306-2c8c56e55d15 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:09 user nova-compute[72724]: INFO nova.compute.manager [None req-5a3945e9-5315-4b8f-8afc-06da2424bd62 tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Get console output
Aug 17 16:42:09 user nova-compute[72724]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 17 16:42:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:11 user nova-compute[72724]: INFO nova.compute.manager [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Detaching volume de069bd2-29ff-4a7c-adf3-5bf83c223fd8
Aug 17 16:42:11 user nova-compute[72724]: INFO nova.virt.block_device [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Attempting to driver detach volume de069bd2-29ff-4a7c-adf3-5bf83c223fd8 from mountpoint /dev/vdb
Aug 17 16:42:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Attempting to detach device vdb from instance c87e81f0-8510-41b6-8d5d-e8cfef19516c from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:42:11 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:42:11 user nova-compute[72724]:   <source dev="/dev/sdf"/>
Aug 17 16:42:11 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:42:11 user nova-compute[72724]:   <serial>de069bd2-29ff-4a7c-adf3-5bf83c223fd8</serial>
Aug 17 16:42:11 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:42:11 user nova-compute[72724]: </disk>
Aug 17 16:42:11 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:42:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully detached device vdb from instance c87e81f0-8510-41b6-8d5d-e8cfef19516c from the persistent domain config.
Aug 17 16:42:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c87e81f0-8510-41b6-8d5d-e8cfef19516c from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:42:11 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:42:11 user nova-compute[72724]:   <source dev="/dev/sdf"/>
Aug 17 16:42:11 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:42:11 user nova-compute[72724]:   <serial>de069bd2-29ff-4a7c-adf3-5bf83c223fd8</serial>
Aug 17 16:42:11 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:42:11 user nova-compute[72724]: </disk>
Aug 17 16:42:11 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290532.0581822, c87e81f0-8510-41b6-8d5d-e8cfef19516c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:42:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully detached device vdb from instance c87e81f0-8510-41b6-8d5d-e8cfef19516c from the live domain config.
Aug 17 16:42:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVugSzwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:42:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3275bccf-fcae-4e01-a1cd-6733c9ae5401]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5f846-229d-4210-bf15-c6868f102fea]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:42:12 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:42:12 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:42:12 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:42:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:42:12 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:42:12 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:42:12 user nova-compute[72724]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 (non-flash)
Aug 17 16:42:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8413d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8'): ({'sdf'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Removing single pathed devices sdf {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76525a80-f865-49c9-a9a7-5392e9f0bcf5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ab17f-d3fb-4f36-bddf-a9a0d1b208a8]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Flushing IO for device /dev/sdf {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1823a3-b212-44dc-b1c7-6982a1241dd3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cec9a4bf-8dc6-400f-b16a-f7a782f088f2]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] SCSI volumes sdf have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2512b58b-7b46-48a0-8505-d648ee2cc391]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4912c56f-25fe-46ae-88cd-742d83ce0cd7]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260]
Aug 17 16:42:12 user nova-compute[72724]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8, portal: 172.16.0.220,3260] successful.
Aug 17 16:42:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e30eb1-df61-42ca-a955-f368b5c27c82]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== disconnect_volume: return (307ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:42:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG nova.objects.instance [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'flavor' on Instance uuid c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-42463c1d-0125-46dd-bf41-9367b6233882 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.797s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.667s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:13 user nova-compute[72724]: INFO nova.compute.manager [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Terminating instance
Aug 17 16:42:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-f3c7e714-8c5f-49fd-98c4-0f9149859c8a req-e3752d59-e6ba-49bc-b598-a6f6c2743eba service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-vif-unplugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f3c7e714-8c5f-49fd-98c4-0f9149859c8a req-e3752d59-e6ba-49bc-b598-a6f6c2743eba service nova] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f3c7e714-8c5f-49fd-98c4-0f9149859c8a req-e3752d59-e6ba-49bc-b598-a6f6c2743eba service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f3c7e714-8c5f-49fd-98c4-0f9149859c8a req-e3752d59-e6ba-49bc-b598-a6f6c2743eba service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-f3c7e714-8c5f-49fd-98c4-0f9149859c8a req-e3752d59-e6ba-49bc-b598-a6f6c2743eba service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] No waiting events found dispatching network-vif-unplugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-f3c7e714-8c5f-49fd-98c4-0f9149859c8a req-e3752d59-e6ba-49bc-b598-a6f6c2743eba service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-vif-unplugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Instance destroyed successfully.
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lazy-loading 'resources' on Instance uuid c87e81f0-8510-41b6-8d5d-e8cfef19516c {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2038101078',display_name='tempest-VolumesSnapshotTestJSON-instance-2038101078',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2038101078',id=29,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvTkMXUlqylQmhYeJx1C55uaD7PB9JhLVVKwfJIC80uJt5/vteUN9JYEor5cWe3SB2JydvPrMGhoMuwDTGYZh4QYy+o0Aq+6D6NrVMCqLGZmd+7DYhZkDMIXUPy7dQofg==',key_name='tempest-keypair-1081736358',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:39:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6683a9e4cd8a44cfb2c5b3be805e57ef',ramdisk_id='',reservation_id='r-eh0uq7it',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-684431818',owner_user_name='tempest-VolumesSnapshotTestJSON-684431818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:39:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a441dd986f9a417aaa3034dca1e0c9ad',uuid=c87e81f0-8510-41b6-8d5d-e8cfef19516c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converting VIF {"id": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "address": "fa:16:3e:f3:02:28", "network": {"id": "14689612-e1db-4c0d-bd90-8f352693d9e6", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2014440586-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6683a9e4cd8a44cfb2c5b3be805e57ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd0a2e8b3-0a", "ovs_interfaceid": "d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_vif [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd0a2e8b3-0a, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:42:14 user nova-compute[72724]: INFO os_vif [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:02:28,bridge_name='br-int',has_traffic_filtering=True,id=d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047,network=Network(14689612-e1db-4c0d-bd90-8f352693d9e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd0a2e8b3-0a')
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVugSzwT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:42:14 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de069bd2-29ff-4a7c-adf3-5bf83c223fd8', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da2eb39-ea87-41ae-8e3f-a0b155402a27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3149c0-8f68-4daf-a08e-d53e69fa1cab]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:42:14 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:42:14 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:42:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:42:14 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:42:14 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:42:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86ee9ca0e0>, {}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Disconnecting from: [] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.060s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] <== disconnect_volume: return (61ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:42:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Deleting instance files /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c_del
Aug 17 16:42:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Deletion of /opt/stack/data/nova/instances/c87e81f0-8510-41b6-8d5d-e8cfef19516c_del complete
Aug 17 16:42:14 user nova-compute[72724]: INFO nova.compute.manager [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 17 16:42:14 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:42:14 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:42:15 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Took 1.03 seconds to deallocate network for instance.
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-5499f497-abe2-4878-897b-62e0c15674d1 req-37a95c6f-519c-443e-b4f9-a75f528729a1 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-vif-deleted-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:15 user nova-compute[72724]: WARNING nova.volume.cinder [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Attachment 1f652072-570e-47b8-a43f-6068c7590464 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 1f652072-570e-47b8-a43f-6068c7590464. (HTTP 404) (Request-ID: req-3ace222e-9b5a-46de-863f-94048cf1fbb8)
Aug 17 16:42:15 user nova-compute[72724]: INFO nova.compute.manager [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Took 0.03 seconds to detach 1 volumes for instance.
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-2e9d3667-cfee-496f-9d09-22cf6e1f75bd req-9113f44e-443b-40fd-a592-a9d1806da847 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received event network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2e9d3667-cfee-496f-9d09-22cf6e1f75bd req-9113f44e-443b-40fd-a592-a9d1806da847 service nova] Acquiring lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2e9d3667-cfee-496f-9d09-22cf6e1f75bd req-9113f44e-443b-40fd-a592-a9d1806da847 service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2e9d3667-cfee-496f-9d09-22cf6e1f75bd req-9113f44e-443b-40fd-a592-a9d1806da847 service nova] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-2e9d3667-cfee-496f-9d09-22cf6e1f75bd req-9113f44e-443b-40fd-a592-a9d1806da847 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] No waiting events found dispatching network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:15 user nova-compute[72724]: WARNING nova.compute.manager [req-2e9d3667-cfee-496f-9d09-22cf6e1f75bd req-9113f44e-443b-40fd-a592-a9d1806da847 service nova] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Received unexpected event network-vif-plugged-d0a2e8b3-0ac5-4ec3-a3ac-713a7acd7047 for instance with vm_state deleted and task_state None.
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290520.6750712, b489f85f-68c4-4cd2-a0e3-53543e6bd4c2 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:42:15 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] VM Stopped (Lifecycle Event)
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f68e744f-2545-4b21-a276-850962d3f3e0 None None] [instance: b489f85f-68c4-4cd2-a0e3-53543e6bd4c2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:15 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Deleted allocations for instance c87e81f0-8510-41b6-8d5d-e8cfef19516c
Aug 17 16:42:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fbbcf100-2c9e-405b-8697-ebffdf138c68 tempest-VolumesSnapshotTestJSON-684431818 tempest-VolumesSnapshotTestJSON-684431818-project-member] Lock "c87e81f0-8510-41b6-8d5d-e8cfef19516c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.499s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:29 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290534.084862, c87e81f0-8510-41b6-8d5d-e8cfef19516c => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:42:29 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] VM Stopped (Lifecycle Event)
Aug 17 16:42:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c87f734b-7164-44a7-88f9-7dfa80146aff None None] [instance: c87e81f0-8510-41b6-8d5d-e8cfef19516c] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:42:33 user nova-compute[72724]: INFO nova.compute.claims [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Claim successful on node user
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:42:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.policy [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfbf2f6beaf44499a30c0a989459ffc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8ad21c16ee4a04a83d6e0261f7d0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:42:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Creating image(s)
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "bf4715ac9cd026e6818fb6988cfdb62cdd7633ce" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "bf4715ac9cd026e6818fb6988cfdb62cdd7633ce" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.part --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG nova.virt.images [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] 576ec697-ffbb-4bc4-9257-36a5c3f27d26 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.part /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Successfully created port: d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.part /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.converted" returned: 0 in 0.316s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "bf4715ac9cd026e6818fb6988cfdb62cdd7633ce" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.227s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "bf4715ac9cd026e6818fb6988cfdb62cdd7633ce" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "bf4715ac9cd026e6818fb6988cfdb62cdd7633ce" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json" returned: 0 in 0.207s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce,backing_fmt=raw /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce,backing_fmt=raw /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk 1073741824" returned: 0 in 0.057s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "bf4715ac9cd026e6818fb6988cfdb62cdd7633ce" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Successfully updated port: d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.compute.manager [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.compute.manager [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing instance network info cache due to event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Cannot resize image /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'migration_context' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Ensure instance console log exists: /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance network_info: |[{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:42:35 user nova-compute[72724]: DEBUG nova.network.neutron [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Start _get_guest_xml network_info=[{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:42:30Z,direct_url=<?>,disk_format='qcow2',id=576ec697-ffbb-4bc4-9257-36a5c3f27d26,min_disk=0,min_ram=0,name='tempest-scenario-img--1090574658',owner='3d8ad21c16ee4a04a83d6e0261f7d0c8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:42:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '576ec697-ffbb-4bc4-9257-36a5c3f27d26'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:42:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:42:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:42:30Z,direct_url=<?>,disk_format='qcow2',id=576ec697-ffbb-4bc4-9257-36a5c3f27d26,min_disk=0,min_ram=0,name='tempest-scenario-img--1090574658',owner='3d8ad21c16ee4a04a83d6e0261f7d0c8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:42:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1801938598',display_name='tempest-TestMinimumBasicScenario-server-1801938598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1801938598',id=31,image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0WplzuawlQ0rQDblM5YOjsDODZzzt1xrC2yLoGgEjU3cZkMyAHyLJoTmYk0FTsd7v0h9ASKP797wdyu+pV0R6Wg+MGZQxHOz9CJLAS4f/i2Am71mOMAzY5wwv3M4P7g==',key_name='tempest-TestMinimumBasicScenario-2050484145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-9f2eo0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:42:34Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=5012ca5f-ac70-4e99-aee0-0b7f62b03976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'pci_devices' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:42:36 user nova-compute[72724]:   <uuid>5012ca5f-ac70-4e99-aee0-0b7f62b03976</uuid>
Aug 17 16:42:36 user nova-compute[72724]:   <name>instance-0000001f</name>
Aug 17 16:42:36 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:42:36 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:42:36 user nova-compute[72724]:   <metadata>
Aug 17 16:42:36 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:42:36 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:42:36 user nova-compute[72724]:       <nova:name>tempest-TestMinimumBasicScenario-server-1801938598</nova:name>
Aug 17 16:42:36 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:42:36</nova:creationTime>
Aug 17 16:42:36 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:42:36 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:42:36 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:42:36 user nova-compute[72724]:       <nova:owner>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:user uuid="cfbf2f6beaf44499a30c0a989459ffc8">tempest-TestMinimumBasicScenario-1956650041-project-member</nova:user>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:project uuid="3d8ad21c16ee4a04a83d6e0261f7d0c8">tempest-TestMinimumBasicScenario-1956650041</nova:project>
Aug 17 16:42:36 user nova-compute[72724]:       </nova:owner>
Aug 17 16:42:36 user nova-compute[72724]:       <nova:root type="image" uuid="576ec697-ffbb-4bc4-9257-36a5c3f27d26"/>
Aug 17 16:42:36 user nova-compute[72724]:       <nova:ports>
Aug 17 16:42:36 user nova-compute[72724]:         <nova:port uuid="d5e6379b-914b-4c8f-8e27-931b973720fd">
Aug 17 16:42:36 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 16:42:36 user nova-compute[72724]:         </nova:port>
Aug 17 16:42:36 user nova-compute[72724]:       </nova:ports>
Aug 17 16:42:36 user nova-compute[72724]:     </nova:instance>
Aug 17 16:42:36 user nova-compute[72724]:   </metadata>
Aug 17 16:42:36 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:42:36 user nova-compute[72724]:     <system>
Aug 17 16:42:36 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:42:36 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:42:36 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:42:36 user nova-compute[72724]:       <entry name="serial">5012ca5f-ac70-4e99-aee0-0b7f62b03976</entry>
Aug 17 16:42:36 user nova-compute[72724]:       <entry name="uuid">5012ca5f-ac70-4e99-aee0-0b7f62b03976</entry>
Aug 17 16:42:36 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:42:36 user nova-compute[72724]:     </system>
Aug 17 16:42:36 user nova-compute[72724]:   </sysinfo>
Aug 17 16:42:36 user nova-compute[72724]:   <os>
Aug 17 16:42:36 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:42:36 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:42:36 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:42:36 user nova-compute[72724]:   </os>
Aug 17 16:42:36 user nova-compute[72724]:   <features>
Aug 17 16:42:36 user nova-compute[72724]:     <acpi/>
Aug 17 16:42:36 user nova-compute[72724]:     <apic/>
Aug 17 16:42:36 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:42:36 user nova-compute[72724]:   </features>
Aug 17 16:42:36 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:42:36 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:42:36 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:42:36 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:42:36 user nova-compute[72724]:   </clock>
Aug 17 16:42:36 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:42:36 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:42:36 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:42:36 user nova-compute[72724]:   </cpu>
Aug 17 16:42:36 user nova-compute[72724]:   <devices>
Aug 17 16:42:36 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:42:36 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:42:36 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk"/>
Aug 17 16:42:36 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:42:36 user nova-compute[72724]:     </disk>
Aug 17 16:42:36 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:42:36 user nova-compute[72724]:       <mac address="fa:16:3e:21:1b:57"/>
Aug 17 16:42:36 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:42:36 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:42:36 user nova-compute[72724]:       <target dev="tapd5e6379b-91"/>
Aug 17 16:42:36 user nova-compute[72724]:     </interface>
Aug 17 16:42:36 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:42:36 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/console.log" append="off"/>
Aug 17 16:42:36 user nova-compute[72724]:     </serial>
Aug 17 16:42:36 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:42:36 user nova-compute[72724]:     <video>
Aug 17 16:42:36 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:42:36 user nova-compute[72724]:     </video>
Aug 17 16:42:36 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:42:36 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:42:36 user nova-compute[72724]:     </rng>
Aug 17 16:42:36 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:42:36 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:42:36 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:42:36 user nova-compute[72724]:     </memballoon>
Aug 17 16:42:36 user nova-compute[72724]:   </devices>
Aug 17 16:42:36 user nova-compute[72724]: </domain>
Aug 17 16:42:36 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1801938598',display_name='tempest-TestMinimumBasicScenario-server-1801938598',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1801938598',id=31,image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0WplzuawlQ0rQDblM5YOjsDODZzzt1xrC2yLoGgEjU3cZkMyAHyLJoTmYk0FTsd7v0h9ASKP797wdyu+pV0R6Wg+MGZQxHOz9CJLAS4f/i2Am71mOMAzY5wwv3M4P7g==',key_name='tempest-TestMinimumBasicScenario-2050484145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-9f2eo0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:42:34Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=5012ca5f-ac70-4e99-aee0-0b7f62b03976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG os_vif [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5e6379b-91, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5e6379b-91, col_values=(('external_ids', {'iface-id': 'd5e6379b-914b-4c8f-8e27-931b973720fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:1b:57', 'vm-uuid': '5012ca5f-ac70-4e99-aee0-0b7f62b03976'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:36 user nova-compute[72724]: INFO os_vif [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91')
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No VIF found with MAC fa:16:3e:21:1b:57, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updated VIF entry in instance network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-042341ff-1a3f-4b5b-80c0-d74177b239af req-5de48cdf-c112-4355-929f-d2f7079cc828 service nova] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:42:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-86e54139-370a-4d82-9464-0718bcca42da req-fb8fc8bf-b55b-4e13-880f-86ba65b1464f service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86e54139-370a-4d82-9464-0718bcca42da req-fb8fc8bf-b55b-4e13-880f-86ba65b1464f service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86e54139-370a-4d82-9464-0718bcca42da req-fb8fc8bf-b55b-4e13-880f-86ba65b1464f service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86e54139-370a-4d82-9464-0718bcca42da req-fb8fc8bf-b55b-4e13-880f-86ba65b1464f service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-86e54139-370a-4d82-9464-0718bcca42da req-fb8fc8bf-b55b-4e13-880f-86ba65b1464f service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:37 user nova-compute[72724]: WARNING nova.compute.manager [req-86e54139-370a-4d82-9464-0718bcca42da req-fb8fc8bf-b55b-4e13-880f-86ba65b1464f service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state building and task_state spawning.
Aug 17 16:42:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-f9ee4ad3-e93c-4048-9e96-ae65f288d4b9 req-4257a9a3-0a7a-4f62-a6fc-14963bd90cd2 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f9ee4ad3-e93c-4048-9e96-ae65f288d4b9 req-4257a9a3-0a7a-4f62-a6fc-14963bd90cd2 service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f9ee4ad3-e93c-4048-9e96-ae65f288d4b9 req-4257a9a3-0a7a-4f62-a6fc-14963bd90cd2 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f9ee4ad3-e93c-4048-9e96-ae65f288d4b9 req-4257a9a3-0a7a-4f62-a6fc-14963bd90cd2 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-f9ee4ad3-e93c-4048-9e96-ae65f288d4b9 req-4257a9a3-0a7a-4f62-a6fc-14963bd90cd2 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:39 user nova-compute[72724]: WARNING nova.compute.manager [req-f9ee4ad3-e93c-4048-9e96-ae65f288d4b9 req-4257a9a3-0a7a-4f62-a6fc-14963bd90cd2 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state building and task_state spawning.
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290559.8656394, 5012ca5f-ac70-4e99-aee0-0b7f62b03976 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:42:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] VM Resumed (Lifecycle Event)
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:42:39 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance spawned successfully.
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:42:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290559.8669407, 5012ca5f-ac70-4e99-aee0-0b7f62b03976 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:42:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] VM Started (Lifecycle Event)
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:42:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:42:39 user nova-compute[72724]: INFO nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Took 6.17 seconds to spawn the instance on the hypervisor.
Aug 17 16:42:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:40 user nova-compute[72724]: INFO nova.compute.manager [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Took 6.86 seconds to build instance.
Aug 17 16:42:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0075573a-b30a-47e9-9522-3cbd8be56f22 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.966s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:42:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:42:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:42:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:42:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:42:45 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:49 user nova-compute[72724]: INFO nova.compute.manager [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Unrescuing
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquired lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:42:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:42:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:42:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=7928MB free_disk=25.247501373291016GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updating instance_info_cache with network_info: [{"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Releasing lock "refresh_cache-936336a5-6ccb-4238-b886-9a00b5bf55d0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'flavor' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-1e270eb4-5cb1-4c05-a74d-3c7b0d37c88f req-32732eae-b80c-49af-8ac3-b5afacd43e2b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1e270eb4-5cb1-4c05-a74d-3c7b0d37c88f req-32732eae-b80c-49af-8ac3-b5afacd43e2b service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1e270eb4-5cb1-4c05-a74d-3c7b0d37c88f req-32732eae-b80c-49af-8ac3-b5afacd43e2b service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1e270eb4-5cb1-4c05-a74d-3c7b0d37c88f req-32732eae-b80c-49af-8ac3-b5afacd43e2b service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-1e270eb4-5cb1-4c05-a74d-3c7b0d37c88f req-32732eae-b80c-49af-8ac3-b5afacd43e2b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:50 user nova-compute[72724]: WARNING nova.compute.manager [req-1e270eb4-5cb1-4c05-a74d-3c7b0d37c88f req-32732eae-b80c-49af-8ac3-b5afacd43e2b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:42:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 59a5dee3-bf14-4196-a8da-c9ea471c0752 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ae9f5ed4-29fe-470f-a689-64ea3d448562 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 936336a5-6ccb-4238-b886-9a00b5bf55d0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:42:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance destroyed successfully.
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.134s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:42:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:42:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:52 user nova-compute[72724]: WARNING nova.compute.manager [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:42:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:52 user nova-compute[72724]: WARNING nova.compute.manager [req-56057364-5c78-4d96-865b-2fc50dbf0228 req-b3d2bc07-6600-4b4d-b9b8-dcc55ad79f84 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state rescued and task_state unrescuing.
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 936336a5-6ccb-4238-b886-9a00b5bf55d0 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290574.2603047, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:42:54 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Resumed (Lifecycle Event)
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4f0e9475-5c32-47ad-996e-a2f542c52027 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:42:54 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290574.2656784, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:42:54 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Started (Lifecycle Event)
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-22f01e87-283d-4631-862a-7ebba4475dbc req-72db0fb0-7b1d-4dad-b278-0320cbe7be8b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-22f01e87-283d-4631-862a-7ebba4475dbc req-72db0fb0-7b1d-4dad-b278-0320cbe7be8b service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-22f01e87-283d-4631-862a-7ebba4475dbc req-72db0fb0-7b1d-4dad-b278-0320cbe7be8b service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-22f01e87-283d-4631-862a-7ebba4475dbc req-72db0fb0-7b1d-4dad-b278-0320cbe7be8b service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:42:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-22f01e87-283d-4631-862a-7ebba4475dbc req-72db0fb0-7b1d-4dad-b278-0320cbe7be8b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:42:54 user nova-compute[72724]: WARNING nova.compute.manager [req-22f01e87-283d-4631-862a-7ebba4475dbc req-72db0fb0-7b1d-4dad-b278-0320cbe7be8b service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state active and task_state None.
Aug 17 16:42:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:42:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:05 user nova-compute[72724]: INFO nova.compute.manager [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Terminating instance
Aug 17 16:43:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-23cec69b-6338-41d4-990c-e2528adf984d req-57962bdf-9acf-4624-b6d4-36e831e150e0 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-unplugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-23cec69b-6338-41d4-990c-e2528adf984d req-57962bdf-9acf-4624-b6d4-36e831e150e0 service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-23cec69b-6338-41d4-990c-e2528adf984d req-57962bdf-9acf-4624-b6d4-36e831e150e0 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-23cec69b-6338-41d4-990c-e2528adf984d req-57962bdf-9acf-4624-b6d4-36e831e150e0 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-23cec69b-6338-41d4-990c-e2528adf984d req-57962bdf-9acf-4624-b6d4-36e831e150e0 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-unplugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-23cec69b-6338-41d4-990c-e2528adf984d req-57962bdf-9acf-4624-b6d4-36e831e150e0 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-unplugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Instance destroyed successfully.
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.objects.instance [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'resources' on Instance uuid 59a5dee3-bf14-4196-a8da-c9ea471c0752 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-220067116',display_name='tempest-ServerRescueNegativeTestJSON-server-220067116',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-220067116',id=15,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:28:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-c10ke00q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:28:38Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=59a5dee3-bf14-4196-a8da-c9ea471c0752,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "853dcaac-14ef-4365-9613-97c8afbbc55a", "address": "fa:16:3e:f4:84:5a", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853dcaac-14", "ovs_interfaceid": "853dcaac-14ef-4365-9613-97c8afbbc55a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG os_vif [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap853dcaac-14, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:06 user nova-compute[72724]: INFO os_vif [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:84:5a,bridge_name='br-int',has_traffic_filtering=True,id=853dcaac-14ef-4365-9613-97c8afbbc55a,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853dcaac-14')
Aug 17 16:43:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Deleting instance files /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752_del
Aug 17 16:43:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Deletion of /opt/stack/data/nova/instances/59a5dee3-bf14-4196-a8da-c9ea471c0752_del complete
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: INFO nova.compute.manager [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 17 16:43:06 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:07 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:43:07 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Took 0.82 seconds to deallocate network for instance.
Aug 17 16:43:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:07 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:43:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:43:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:07 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Deleted allocations for instance 59a5dee3-bf14-4196-a8da-c9ea471c0752
Aug 17 16:43:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-65a4cdaf-e43a-4ffb-bf19-67d5e7ab970b tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:08 user nova-compute[72724]: WARNING nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state deleted and task_state None.
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:08 user nova-compute[72724]: WARNING nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state deleted and task_state None.
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Acquiring lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] Lock "59a5dee3-bf14-4196-a8da-c9ea471c0752-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] No waiting events found dispatching network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:08 user nova-compute[72724]: WARNING nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received unexpected event network-vif-plugged-853dcaac-14ef-4365-9613-97c8afbbc55a for instance with vm_state deleted and task_state None.
Aug 17 16:43:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c1cc990-4a90-4116-8659-394cc3d9a8e5 req-b191a336-4bf2-4818-b040-4f9c9831fba8 service nova] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Received event network-vif-deleted-853dcaac-14ef-4365-9613-97c8afbbc55a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:10 user nova-compute[72724]: INFO nova.compute.manager [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Terminating instance
Aug 17 16:43:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-8e6bca60-20d7-422d-b945-208d4a81d078 req-f29675ac-1163-45d7-973c-15ca670075e5 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8e6bca60-20d7-422d-b945-208d4a81d078 req-f29675ac-1163-45d7-973c-15ca670075e5 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8e6bca60-20d7-422d-b945-208d4a81d078 req-f29675ac-1163-45d7-973c-15ca670075e5 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8e6bca60-20d7-422d-b945-208d4a81d078 req-f29675ac-1163-45d7-973c-15ca670075e5 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-8e6bca60-20d7-422d-b945-208d4a81d078 req-f29675ac-1163-45d7-973c-15ca670075e5 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-8e6bca60-20d7-422d-b945-208d4a81d078 req-f29675ac-1163-45d7-973c-15ca670075e5 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Instance destroyed successfully.
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'resources' on Instance uuid ae9f5ed4-29fe-470f-a689-64ea3d448562 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1645846581',display_name='tempest-ServerActionsTestOtherA-server-1645846581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1645846581',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:38:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-g90fryi0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:40:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=ae9f5ed4-29fe-470f-a689-64ea3d448562,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "2abc8a0c-a18d-4681-969b-12954592e6ea", "address": "fa:16:3e:0f:52:1b", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2abc8a0c-a1", "ovs_interfaceid": "2abc8a0c-a18d-4681-969b-12954592e6ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_vif [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2abc8a0c-a1, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: INFO os_vif [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:52:1b,bridge_name='br-int',has_traffic_filtering=True,id=2abc8a0c-a18d-4681-969b-12954592e6ea,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2abc8a0c-a1')
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'laqYJwHg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:43:11 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0dec42-f94c-499f-b0f6-56f87f9928ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cc4074f-557a-45d5-aa07-6327f458c043]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:43:11 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:43:11 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:43:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:43:11 user nova-compute[72724]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb (non-flash)
Aug 17 16:43:11 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:43:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e024ab00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d87169-e8a3-475d-a051-fd96900841b3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea4641d-d2a7-4a56-9e86-b24a2a799f65]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f6555a-18c8-4d59-8c76-d2b6e7cdd7ae]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.063s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ce8cf1-e5af-413c-b72a-6387e26f1ebc]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ecc184-3800-48ce-a2c5-7a0711d32d09]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aae5671-c170-48fd-9ec7-2713be2181a3]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260]
Aug 17 16:43:11 user nova-compute[72724]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb, portal: 172.16.0.220,3260] successful.
Aug 17 16:43:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90245363-e382-4a2b-adf8-52bfecc898bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d355fb72-2c4b-4a5a-a220-e36b0a9e9e63]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] <== disconnect_volume: return (323ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:43:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Deleting instance files /opt/stack/data/nova/instances/ae9f5ed4-29fe-470f-a689-64ea3d448562_del
Aug 17 16:43:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Deletion of /opt/stack/data/nova/instances/ae9f5ed4-29fe-470f-a689-64ea3d448562_del complete
Aug 17 16:43:11 user nova-compute[72724]: INFO nova.compute.manager [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 17 16:43:11 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:43:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:43:12 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Took 0.73 seconds to deallocate network for instance.
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-42556cbe-a128-49bd-b6ec-bc555ec29972 req-551a98fe-5004-4c3b-857e-50a855469ed8 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-deleted-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:12 user nova-compute[72724]: WARNING nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state deleting.
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:12 user nova-compute[72724]: WARNING nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state deleting.
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:12 user nova-compute[72724]: WARNING nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state deleting.
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-unplugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Acquiring lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] No waiting events found dispatching network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:12 user nova-compute[72724]: WARNING nova.compute.manager [req-a038754b-aa90-492c-84d6-48465c36c86e req-a74b8d82-e38a-491e-8a78-44599d7f26f6 service nova] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Received unexpected event network-vif-plugged-2abc8a0c-a18d-4681-969b-12954592e6ea for instance with vm_state active and task_state deleting.
Aug 17 16:43:13 user nova-compute[72724]: INFO nova.compute.manager [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Took 0.80 seconds to detach 1 volumes for instance.
Aug 17 16:43:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Deleting volume: 90245363-e382-4a2b-adf8-52bfecc898bb {{(pid=72724) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 16:43:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:43:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:43:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:13 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Deleted allocations for instance ae9f5ed4-29fe-470f-a689-64ea3d448562
Aug 17 16:43:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-bce3c1c2-ecf2-43bb-a556-ddcf8ba015bf tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "ae9f5ed4-29fe-470f-a689-64ea3d448562" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.280s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:21 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290586.300964, 59a5dee3-bf14-4196-a8da-c9ea471c0752 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:43:21 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] VM Stopped (Lifecycle Event)
Aug 17 16:43:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-bab64eaf-f088-4182-b8fe-4ec9ee8788c2 None None] [instance: 59a5dee3-bf14-4196-a8da-c9ea471c0752] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:43:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290591.3380203, ae9f5ed4-29fe-470f-a689-64ea3d448562 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:43:26 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] VM Stopped (Lifecycle Event)
Aug 17 16:43:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e2d8cdb4-1773-4d8c-b0a2-bfea13cbf215 None None] [instance: ae9f5ed4-29fe-470f-a689-64ea3d448562] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:43:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:43:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [{"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-00db2a89-a70b-461d-a887-ccba383edce6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:43:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:43:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8085MB free_disk=25.24637222290039GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f09067a8-3cf3-4fe7-aa75-78348da59adb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 936336a5-6ccb-4238-b886-9a00b5bf55d0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:43:49 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.365s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:43:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:43:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:56 user nova-compute[72724]: INFO nova.compute.manager [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Terminating instance
Aug 17 16:43:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbedb966-4d08-457e-93ca-5413d15b2fae req-58bdd1c3-0864-4d03-810a-bfe32cc18cf6 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bbedb966-4d08-457e-93ca-5413d15b2fae req-58bdd1c3-0864-4d03-810a-bfe32cc18cf6 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bbedb966-4d08-457e-93ca-5413d15b2fae req-58bdd1c3-0864-4d03-810a-bfe32cc18cf6 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bbedb966-4d08-457e-93ca-5413d15b2fae req-58bdd1c3-0864-4d03-810a-bfe32cc18cf6 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbedb966-4d08-457e-93ca-5413d15b2fae req-58bdd1c3-0864-4d03-810a-bfe32cc18cf6 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbedb966-4d08-457e-93ca-5413d15b2fae req-58bdd1c3-0864-4d03-810a-bfe32cc18cf6 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-unplugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:43:57 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Instance destroyed successfully.
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lazy-loading 'resources' on Instance uuid f09067a8-3cf3-4fe7-aa75-78348da59adb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:26:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-697311111',display_name='tempest-ServerRescueNegativeTestJSON-server-697311111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-697311111',id=14,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:31:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4767040317048ddb4479fa7c82f3384',ramdisk_id='',reservation_id='r-rytohmqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2097085369',owner_user_name='tempest-ServerRescueNegativeTestJSON-2097085369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:33:24Z,user_data=None,user_id='558eaa9f170b40978f6004f1e6aff3e9',uuid=f09067a8-3cf3-4fe7-aa75-78348da59adb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converting VIF {"id": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "address": "fa:16:3e:03:95:21", "network": {"id": "2546ef5d-2e7d-4c5e-944c-11b945f77b1b", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1650946040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4767040317048ddb4479fa7c82f3384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbac9e36-0f", "ovs_interfaceid": "dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG os_vif [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbac9e36-0f, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:43:57 user nova-compute[72724]: INFO os_vif [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:95:21,bridge_name='br-int',has_traffic_filtering=True,id=dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9,network=Network(2546ef5d-2e7d-4c5e-944c-11b945f77b1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbac9e36-0f')
Aug 17 16:43:57 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Deleting instance files /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb_del
Aug 17 16:43:57 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Deletion of /opt/stack/data/nova/instances/f09067a8-3cf3-4fe7-aa75-78348da59adb_del complete
Aug 17 16:43:57 user nova-compute[72724]: INFO nova.compute.manager [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 16:43:57 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:43:57 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Took 0.52 seconds to deallocate network for instance.
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-20e45115-212f-49c6-8723-224f2df6a834 req-51f365b0-c840-45f5-a8ad-d78b665de7e7 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-deleted-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:43:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.262s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:58 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Deleted allocations for instance f09067a8-3cf3-4fe7-aa75-78348da59adb
Aug 17 16:43:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-695cb366-bac2-4439-b24e-c93d505a0f49 tempest-ServerRescueNegativeTestJSON-2097085369 tempest-ServerRescueNegativeTestJSON-2097085369-project-member] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-b38bae06-247d-4e40-88ce-1d49d3d9f9f7 req-5f737cb5-5199-457e-90c8-d09b4ecff4b3 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:43:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b38bae06-247d-4e40-88ce-1d49d3d9f9f7 req-5f737cb5-5199-457e-90c8-d09b4ecff4b3 service nova] Acquiring lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:43:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b38bae06-247d-4e40-88ce-1d49d3d9f9f7 req-5f737cb5-5199-457e-90c8-d09b4ecff4b3 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:43:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b38bae06-247d-4e40-88ce-1d49d3d9f9f7 req-5f737cb5-5199-457e-90c8-d09b4ecff4b3 service nova] Lock "f09067a8-3cf3-4fe7-aa75-78348da59adb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:43:58 user nova-compute[72724]: DEBUG nova.compute.manager [req-b38bae06-247d-4e40-88ce-1d49d3d9f9f7 req-5f737cb5-5199-457e-90c8-d09b4ecff4b3 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] No waiting events found dispatching network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:43:58 user nova-compute[72724]: WARNING nova.compute.manager [req-b38bae06-247d-4e40-88ce-1d49d3d9f9f7 req-5f737cb5-5199-457e-90c8-d09b4ecff4b3 service nova] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Received unexpected event network-vif-plugged-dbac9e36-0f3a-4a51-b7ad-c8f5f7b89cd9 for instance with vm_state deleted and task_state None.
Aug 17 16:44:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:08 user nova-compute[72724]: INFO nova.compute.manager [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Terminating instance
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-36dfde74-975e-4557-92c6-d4b852fd071b req-254d35e4-5593-4cab-af53-e681c5f8aec5 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-vif-unplugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-36dfde74-975e-4557-92c6-d4b852fd071b req-254d35e4-5593-4cab-af53-e681c5f8aec5 service nova] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-36dfde74-975e-4557-92c6-d4b852fd071b req-254d35e4-5593-4cab-af53-e681c5f8aec5 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-36dfde74-975e-4557-92c6-d4b852fd071b req-254d35e4-5593-4cab-af53-e681c5f8aec5 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-36dfde74-975e-4557-92c6-d4b852fd071b req-254d35e4-5593-4cab-af53-e681c5f8aec5 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] No waiting events found dispatching network-vif-unplugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-36dfde74-975e-4557-92c6-d4b852fd071b req-254d35e4-5593-4cab-af53-e681c5f8aec5 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-vif-unplugged-605f0625-4ba6-4c19-8562-47d6de868f1b for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:44:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Instance destroyed successfully.
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lazy-loading 'resources' on Instance uuid a0f11a53-3d01-4ad5-bc55-5df42490f7f2 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-299344490',display_name='tempest-ServerActionsTestOtherA-server-299344490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-299344490',id=10,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdDmWtlRkdMdM7nolizJt/vCz82eOq4/zGBRg8enzuX0ybH1WSOfP9p3/6NF/Ejwne37vXVijknt1jdiyMKw/fbXk99QbZMHLAZ2xTcla6A5m+/zfp64rZJbKqk7yqCDA==',key_name='tempest-keypair-1379699336',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6f4518061f274934833bc6801498ec91',ramdisk_id='',reservation_id='r-n6z7kj0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2020786536',owner_user_name='tempest-ServerActionsTestOtherA-2020786536-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:24:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44441d94d244ec5a0e0b00617a3229f',uuid=a0f11a53-3d01-4ad5-bc55-5df42490f7f2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converting VIF {"id": "605f0625-4ba6-4c19-8562-47d6de868f1b", "address": "fa:16:3e:ad:09:06", "network": {"id": "97e1220d-f650-404e-850e-123eca8050bf", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1262100038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6f4518061f274934833bc6801498ec91", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605f0625-4b", "ovs_interfaceid": "605f0625-4ba6-4c19-8562-47d6de868f1b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG os_vif [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap605f0625-4b, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:44:08 user nova-compute[72724]: INFO os_vif [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:09:06,bridge_name='br-int',has_traffic_filtering=True,id=605f0625-4ba6-4c19-8562-47d6de868f1b,network=Network(97e1220d-f650-404e-850e-123eca8050bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605f0625-4b')
Aug 17 16:44:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Deleting instance files /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2_del
Aug 17 16:44:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Deletion of /opt/stack/data/nova/instances/a0f11a53-3d01-4ad5-bc55-5df42490f7f2_del complete
Aug 17 16:44:08 user nova-compute[72724]: INFO nova.compute.manager [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 16:44:08 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:44:08 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:44:09 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Took 0.51 seconds to deallocate network for instance.
Aug 17 16:44:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-4a246a76-edc7-4591-bceb-4ccb4f1162e3 req-f8a1946d-280d-4b13-bb1d-f90aafa839c5 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-vif-deleted-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:44:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:09 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Deleted allocations for instance a0f11a53-3d01-4ad5-bc55-5df42490f7f2
Aug 17 16:44:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0835c225-bb52-439e-9fa6-5e4b3a749fcc tempest-ServerActionsTestOtherA-2020786536 tempest-ServerActionsTestOtherA-2020786536-project-member] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.788s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-ad33e619-1fca-4846-b48a-7e838998be54 req-6549f0cd-e96b-4ab1-aafc-da130a049f76 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received event network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ad33e619-1fca-4846-b48a-7e838998be54 req-6549f0cd-e96b-4ab1-aafc-da130a049f76 service nova] Acquiring lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ad33e619-1fca-4846-b48a-7e838998be54 req-6549f0cd-e96b-4ab1-aafc-da130a049f76 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ad33e619-1fca-4846-b48a-7e838998be54 req-6549f0cd-e96b-4ab1-aafc-da130a049f76 service nova] Lock "a0f11a53-3d01-4ad5-bc55-5df42490f7f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-ad33e619-1fca-4846-b48a-7e838998be54 req-6549f0cd-e96b-4ab1-aafc-da130a049f76 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] No waiting events found dispatching network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:44:10 user nova-compute[72724]: WARNING nova.compute.manager [req-ad33e619-1fca-4846-b48a-7e838998be54 req-6549f0cd-e96b-4ab1-aafc-da130a049f76 service nova] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Received unexpected event network-vif-plugged-605f0625-4ba6-4c19-8562-47d6de868f1b for instance with vm_state deleted and task_state None.
Aug 17 16:44:12 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290637.0293946, f09067a8-3cf3-4fe7-aa75-78348da59adb => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:44:12 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] VM Stopped (Lifecycle Event)
Aug 17 16:44:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3e58afab-90d4-4f07-80cb-ea612d3d43e9 None None] [instance: f09067a8-3cf3-4fe7-aa75-78348da59adb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:44:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:44:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:23 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290648.7730908, a0f11a53-3d01-4ad5-bc55-5df42490f7f2 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:44:23 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] VM Stopped (Lifecycle Event)
Aug 17 16:44:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-147e2ff6-2c96-45e7-845f-54fa36fa7a6d None None] [instance: a0f11a53-3d01-4ad5-bc55-5df42490f7f2] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:44:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'flavor' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:44:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:28 user nova-compute[72724]: INFO nova.compute.manager [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Attaching volume ed5f8b32-72f7-4163-a17b-e20b770003fc to /dev/vdb
Aug 17 16:44:28 user nova-compute[72724]: DEBUG os_brick.utils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3405ab4-04f8-42a3-864b-a585988451e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc63b97-c370-4ec6-a8d9-d93cdc4cf2cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9254dc24-e42f-4bf8-a9e3-741eb9b66311]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d5b203-6160-4c26-80d3-18162ae5ef1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:44:28 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:44:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[43626ef8-7e5a-4aed-8f12-7af3e8ed0b71]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG os_brick.utils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating existing volume attachment record: 966bbcc8-d872-4319-a30c-9c4e9931566d {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:44:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:44:38 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:44:38 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:44:38 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a004a6a9-74eb-4060-aae0-a9ab741bced3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:44:38 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca6d69c-aad9-4c18-ac55-e4aff675ef0a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc] added
Aug 17 16:44:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90bb7c-c446-444f-82d6-8cc1d3c455b4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0988f6-9329-4dd2-a666-386afb03c259]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrksjpeK {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrksjpeK" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11e0f03-d723-4956-b098-be51908366ff]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PrksjpeK'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2019019-ed36-4663-a22a-fd95635a229e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3800b3d3-2487-45cf-93d4-f17e604f7636]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc1923-fe2f-4040-8dc5-56245ad2cb0e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]
Aug 17 16:44:38 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.
Aug 17 16:44:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[28feb286-5d44-42e2-99b7-45c3702a81e5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c0e7b-3703-47a5-bf6f-14804ec00b88]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:44:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:44:38 user nova-compute[72724]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:44:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[057dfae1-eb16-47f6-bc5c-b6a57e7ca418]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:44:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:44:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:44:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '23732656130613132', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:44:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732656130613132', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:44:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'flavor' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:44:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:44:39 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:44:39 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:44:39 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:44:39 user nova-compute[72724]:   <serial>ed5f8b32-72f7-4163-a17b-e20b770003fc</serial>
Aug 17 16:44:39 user nova-compute[72724]: </disk>
Aug 17 16:44:39 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:40 user nova-compute[72724]: INFO nova.compute.manager [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Terminating instance
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No VIF found with MAC fa:16:3e:21:1b:57, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3c858ce6-3fbc-4164-b366-743711b7390f tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.410s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7586e23-0128-438e-b052-f9f2d9109acc req-91347a79-c646-4a0e-8c1f-5f0dfb0128f0 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7586e23-0128-438e-b052-f9f2d9109acc req-91347a79-c646-4a0e-8c1f-5f0dfb0128f0 service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7586e23-0128-438e-b052-f9f2d9109acc req-91347a79-c646-4a0e-8c1f-5f0dfb0128f0 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d7586e23-0128-438e-b052-f9f2d9109acc req-91347a79-c646-4a0e-8c1f-5f0dfb0128f0 service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7586e23-0128-438e-b052-f9f2d9109acc req-91347a79-c646-4a0e-8c1f-5f0dfb0128f0 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-d7586e23-0128-438e-b052-f9f2d9109acc req-91347a79-c646-4a0e-8c1f-5f0dfb0128f0 service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-unplugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Instance destroyed successfully.
Aug 17 16:44:40 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'resources' on Instance uuid 936336a5-6ccb-4238-b886-9a00b5bf55d0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:39:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-369781755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-369781755',id=30,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-kmekcluf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:42:54Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=936336a5-6ccb-4238-b886-9a00b5bf55d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "address": "fa:16:3e:55:4c:e8", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb68bb142-cc", "ovs_interfaceid": "b68bb142-cc64-4a68-bcfa-bd96a1e1c279", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_vif [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb68bb142-cc, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:41 user nova-compute[72724]: INFO os_vif [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:4c:e8,bridge_name='br-int',has_traffic_filtering=True,id=b68bb142-cc64-4a68-bcfa-bd96a1e1c279,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb68bb142-cc')
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lWUrpVQv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:44:41 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5a6267-614c-4f25-be2b-5be2a6a2afc4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d891f4-d223-4a4d-898f-d016f184a74b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:44:41 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:44:41 user nova-compute[72724]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:44:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:44:41 user nova-compute[72724]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 (non-flash)
Aug 17 16:44:41 user nova-compute[72724]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:44:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0249360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607'): ({'sdd'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Removing single pathed devices sdd {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fbba14-8a5b-4880-8cc4-e9d76deec254]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbec45d3-6620-45d8-8af9-0a8e41daf9e5]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flushing IO for device /dev/sdd {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3500e011-c02d-4b21-b006-0151a00d3121]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[738abfb7-adfe-448b-83e4-fafc89238501]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a514927-f853-4ab5-99bd-ed0194a0e349]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db54ca5-9f8d-46fe-b35e-2d9c5cb79149]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260]
Aug 17 16:44:41 user nova-compute[72724]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607, portal: 172.16.0.220,3260] successful.
Aug 17 16:44:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07e93d31-2241-4a6f-9e04-9ed310b69607 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefaa4a4-19b4-481e-b177-e01d996b93b3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== disconnect_volume: return (301ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:44:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Deleting instance files /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0_del
Aug 17 16:44:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Deletion of /opt/stack/data/nova/instances/936336a5-6ccb-4238-b886-9a00b5bf55d0_del complete
Aug 17 16:44:41 user nova-compute[72724]: INFO nova.compute.manager [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 17 16:44:41 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:44:41 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:44:41 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Took 0.54 seconds to deallocate network for instance.
Aug 17 16:44:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] Acquiring lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] No waiting events found dispatching network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:44:42 user nova-compute[72724]: WARNING nova.compute.manager [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received unexpected event network-vif-plugged-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 for instance with vm_state active and task_state deleting.
Aug 17 16:44:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-e83fd200-f27a-4710-8dbe-2588a7bd16e6 req-f26b34e2-b4f9-482a-9995-709e20bfa1ab service nova] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Received event network-vif-deleted-b68bb142-cc64-4a68-bcfa-bd96a1e1c279 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:42 user nova-compute[72724]: INFO nova.compute.manager [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Took 0.85 seconds to detach 1 volumes for instance.
Aug 17 16:44:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:43 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:44:43 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:44:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:43 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Deleted allocations for instance 936336a5-6ccb-4238-b886-9a00b5bf55d0
Aug 17 16:44:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ba4935a0-9fe1-4911-a5c6-2983c1831960 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "936336a5-6ccb-4238-b886-9a00b5bf55d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.061s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:44:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:44:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:44:47 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Updating instance_info_cache with network_info: [{"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-89d711cf-d3d2-4cfa-9766-eac4523e0f47" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:44:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:44:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:44:49 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.292346954345703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:44:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.307s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:44:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:44:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing instance network info cache due to event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:44:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:44:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:44:51 user nova-compute[72724]: DEBUG nova.network.neutron [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:44:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updated VIF entry in instance network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:44:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:44:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1115c31e-d018-45bc-a653-c9a19354de75 req-e653c9e3-8e20-488c-b813-ab99960e7365 service nova] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing instance network info cache due to event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updated VIF entry in instance network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:44:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e8196e8-cfad-492e-871a-f23208ba918d req-2e6926b7-6fa4-4a2d-aec0-6a1a033c439c service nova] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:44:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:55 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290680.9809384, 936336a5-6ccb-4238-b886-9a00b5bf55d0 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:44:55 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] VM Stopped (Lifecycle Event)
Aug 17 16:44:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-469b8576-6cbb-4a02-9cf6-c45282edf8bb None None] [instance: 936336a5-6ccb-4238-b886-9a00b5bf55d0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:44:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:44:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:45:01 user nova-compute[72724]: INFO nova.compute.claims [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Claim successful on node user
Aug 17 16:45:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:01 user nova-compute[72724]: INFO nova.compute.manager [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Rebooting instance
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:45:01 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:45:01 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Creating image(s)
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "/opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.policy [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05a8d77a3b04cc783d6ef9fdea15526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d8a38870654abe8b40aeb3ee406293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk 1073741824" returned: 0 in 0.054s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Cannot resize image /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'migration_context' on Instance uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Ensure instance console log exists: /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance destroyed successfully.
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'resources' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1801938598',display_name='tempest-TestMinimumBasicScenario-server-1801938598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1801938598',id=31,image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0WplzuawlQ0rQDblM5YOjsDODZzzt1xrC2yLoGgEjU3cZkMyAHyLJoTmYk0FTsd7v0h9ASKP797wdyu+pV0R6Wg+MGZQxHOz9CJLAS4f/i2Am71mOMAzY5wwv3M4P7g==',key_name='tempest-TestMinimumBasicScenario-2050484145',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-9f2eo0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:45:02Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=5012ca5f-ac70-4e99-aee0-0b7f62b03976,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5e6379b-91, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:03 user nova-compute[72724]: INFO os_vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91')
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Successfully created port: b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:45:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c16ba40-af30-4dd7-aeaa-492575a142de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0adaed4-56b9-4290-a61e-67dcbae45707]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:45:03 user nova-compute[72724]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:45:03 user nova-compute[72724]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86ba3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af584b80-95e5-4629-9260-1f793c0bce5f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ac5ec0-9347-49d1-b63e-3826d95e5648]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[54dfb330-145d-4dfc-b15b-34fb562f15df]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccd55c5-c1d2-4b0d-8b32-c24d8dbf2ec9]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd50904-db61-4d4f-a84f-a888dc598c2a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9574ef23-af72-40e7-a2bb-ee3134670411]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]
Aug 17 16:45:03 user nova-compute[72724]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a400a080-f39c-4870-95bb-492387af74f5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== disconnect_volume: return (278ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Start _get_guest_xml network_info=[{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=576ec697-ffbb-4bc4-9257-36a5c3f27d26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '576ec697-ffbb-4bc4-9257-36a5c3f27d26'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '966bbcc8-d872-4319-a30c-9c4e9931566d', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '5012ca5f-ac70-4e99-aee0-0b7f62b03976', 'attached_at': '', 'detached_at': '', 'volume_id': 'ed5f8b32-72f7-4163-a17b-e20b770003fc', 'serial': 'ed5f8b32-72f7-4163-a17b-e20b770003fc'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:45:03 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:03 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=576ec697-ffbb-4bc4-9257-36a5c3f27d26,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:45:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:45:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:45:03 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c2bed2-5c79-4881-a36f-998c5fa3334b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:45:03 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f0eb0b-da13-4c41-8624-f9507d7c8488]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc] added
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e108bb2c-46b8-4582-9321-8e0732cc4f67]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6b8160-847a-44cc-8af1-32622f7ec8e9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrksjpeK {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PrksjpeK" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4be4b5-9209-4631-89e6-f729182b4fc2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PrksjpeK'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[472fe3f5-f108-42d6-a3fe-02b1f853d4eb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d051b684-ed21-4bec-9266-08f797cbbc01]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82e0b4b-bdef-4d9e-a838-10ba9e39d811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]
Aug 17 16:45:03 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f914b4d4-9f96-46cd-ae3a-4d2734309527]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c037ba-e108-4a2d-ad47-39f49ae92492]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:45:03 user nova-compute[72724]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:45:03 user nova-compute[72724]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:45:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8559f33-b18f-4ed3-b40f-86fbe8d56f2e]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:45:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Successfully updated port: b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquired lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-1b2886fe-3f27-4b57-83e2-94d589b4b7e3 req-6359608c-1e42-42b4-a8c4-9504b7898a8a service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-unplugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1b2886fe-3f27-4b57-83e2-94d589b4b7e3 req-6359608c-1e42-42b4-a8c4-9504b7898a8a service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1b2886fe-3f27-4b57-83e2-94d589b4b7e3 req-6359608c-1e42-42b4-a8c4-9504b7898a8a service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1b2886fe-3f27-4b57-83e2-94d589b4b7e3 req-6359608c-1e42-42b4-a8c4-9504b7898a8a service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-1b2886fe-3f27-4b57-83e2-94d589b4b7e3 req-6359608c-1e42-42b4-a8c4-9504b7898a8a service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-unplugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:04 user nova-compute[72724]: WARNING nova.compute.manager [req-1b2886fe-3f27-4b57-83e2-94d589b4b7e3 req-6359608c-1e42-42b4-a8c4-9504b7898a8a service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-unplugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state active and task_state reboot_started_hard.
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-changed-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Refreshing instance network info cache due to event network-changed-b6cc95c9-50ba-4713-82dc-a89a9e446515. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] Acquiring lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updating instance_info_cache with network_info: [{"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Releasing lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Instance network_info: |[{"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] Acquired lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Refreshing network info cache for port b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Start _get_guest_xml network_info=[{"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:45:04 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:04 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162594149',display_name='tempest-AttachVolumeNegativeTest-server-1162594149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162594149',id=32,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl7Z8nqAExgPcmueYfzYdEod0GXHAIf+d0p4dw2IWJ5Tk2Uvwwg8dTgtYFmeBSm0XkxPqNrH2mhMCZbzInWyvt2N8Dyrs9LipTxErxwIFcsuTDL+68+YkfM3LC+Rr5trg==',key_name='tempest-keypair-1907534712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-vawawshj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=e0589f44-f104-4dd8-adca-f097d48d1fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'pci_devices' on Instance uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:45:04 user nova-compute[72724]:   <uuid>e0589f44-f104-4dd8-adca-f097d48d1fe5</uuid>
Aug 17 16:45:04 user nova-compute[72724]:   <name>instance-00000020</name>
Aug 17 16:45:04 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:45:04 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:45:04 user nova-compute[72724]:   <metadata>
Aug 17 16:45:04 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:45:04 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:45:04 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1162594149</nova:name>
Aug 17 16:45:04 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:45:04</nova:creationTime>
Aug 17 16:45:04 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:45:04 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:45:04 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:45:04 user nova-compute[72724]:       <nova:owner>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:user uuid="d05a8d77a3b04cc783d6ef9fdea15526">tempest-AttachVolumeNegativeTest-1491105836-project-member</nova:user>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:project uuid="d5d8a38870654abe8b40aeb3ee406293">tempest-AttachVolumeNegativeTest-1491105836</nova:project>
Aug 17 16:45:04 user nova-compute[72724]:       </nova:owner>
Aug 17 16:45:04 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:45:04 user nova-compute[72724]:       <nova:ports>
Aug 17 16:45:04 user nova-compute[72724]:         <nova:port uuid="b6cc95c9-50ba-4713-82dc-a89a9e446515">
Aug 17 16:45:04 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 16:45:04 user nova-compute[72724]:         </nova:port>
Aug 17 16:45:04 user nova-compute[72724]:       </nova:ports>
Aug 17 16:45:04 user nova-compute[72724]:     </nova:instance>
Aug 17 16:45:04 user nova-compute[72724]:   </metadata>
Aug 17 16:45:04 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:45:04 user nova-compute[72724]:     <system>
Aug 17 16:45:04 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:45:04 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:45:04 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:45:04 user nova-compute[72724]:       <entry name="serial">e0589f44-f104-4dd8-adca-f097d48d1fe5</entry>
Aug 17 16:45:04 user nova-compute[72724]:       <entry name="uuid">e0589f44-f104-4dd8-adca-f097d48d1fe5</entry>
Aug 17 16:45:04 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:45:04 user nova-compute[72724]:     </system>
Aug 17 16:45:04 user nova-compute[72724]:   </sysinfo>
Aug 17 16:45:04 user nova-compute[72724]:   <os>
Aug 17 16:45:04 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:45:04 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:45:04 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:45:04 user nova-compute[72724]:   </os>
Aug 17 16:45:04 user nova-compute[72724]:   <features>
Aug 17 16:45:04 user nova-compute[72724]:     <acpi/>
Aug 17 16:45:04 user nova-compute[72724]:     <apic/>
Aug 17 16:45:04 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:45:04 user nova-compute[72724]:   </features>
Aug 17 16:45:04 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:45:04 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:45:04 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:45:04 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:45:04 user nova-compute[72724]:   </clock>
Aug 17 16:45:04 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:45:04 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:45:04 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:45:04 user nova-compute[72724]:   </cpu>
Aug 17 16:45:04 user nova-compute[72724]:   <devices>
Aug 17 16:45:04 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:45:04 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:45:04 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk"/>
Aug 17 16:45:04 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:45:04 user nova-compute[72724]:     </disk>
Aug 17 16:45:04 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:45:04 user nova-compute[72724]:       <mac address="fa:16:3e:41:9a:a0"/>
Aug 17 16:45:04 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:45:04 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:45:04 user nova-compute[72724]:       <target dev="tapb6cc95c9-50"/>
Aug 17 16:45:04 user nova-compute[72724]:     </interface>
Aug 17 16:45:04 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:45:04 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/console.log" append="off"/>
Aug 17 16:45:04 user nova-compute[72724]:     </serial>
Aug 17 16:45:04 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:45:04 user nova-compute[72724]:     <video>
Aug 17 16:45:04 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:45:04 user nova-compute[72724]:     </video>
Aug 17 16:45:04 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:45:04 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:45:04 user nova-compute[72724]:     </rng>
Aug 17 16:45:04 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:45:04 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:45:04 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:45:04 user nova-compute[72724]:     </memballoon>
Aug 17 16:45:04 user nova-compute[72724]:   </devices>
Aug 17 16:45:04 user nova-compute[72724]: </domain>
Aug 17 16:45:04 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162594149',display_name='tempest-AttachVolumeNegativeTest-server-1162594149',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162594149',id=32,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl7Z8nqAExgPcmueYfzYdEod0GXHAIf+d0p4dw2IWJ5Tk2Uvwwg8dTgtYFmeBSm0XkxPqNrH2mhMCZbzInWyvt2N8Dyrs9LipTxErxwIFcsuTDL+68+YkfM3LC+Rr5trg==',key_name='tempest-keypair-1907534712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-vawawshj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:45:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=e0589f44-f104-4dd8-adca-f097d48d1fe5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG os_vif [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6cc95c9-50, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6cc95c9-50, col_values=(('external_ids', {'iface-id': 'b6cc95c9-50ba-4713-82dc-a89a9e446515', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:9a:a0', 'vm-uuid': 'e0589f44-f104-4dd8-adca-f097d48d1fe5'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:04 user nova-compute[72724]: INFO os_vif [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50')
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:41:9a:a0, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updated VIF entry in instance network info cache for port b6cc95c9-50ba-4713-82dc-a89a9e446515. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updating instance_info_cache with network_info: [{"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dd9a2470-e7d8-44ab-a5d3-60c5bab72324 req-d2bfe7a4-ffba-4d45-80f9-c4533a3f5000 service nova] Releasing lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23732656130613132', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732656130613132', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1801938598',display_name='tempest-TestMinimumBasicScenario-server-1801938598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1801938598',id=31,image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0WplzuawlQ0rQDblM5YOjsDODZzzt1xrC2yLoGgEjU3cZkMyAHyLJoTmYk0FTsd7v0h9ASKP797wdyu+pV0R6Wg+MGZQxHOz9CJLAS4f/i2Am71mOMAzY5wwv3M4P7g==',key_name='tempest-TestMinimumBasicScenario-2050484145',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-9f2eo0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:45:02Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=5012ca5f-ac70-4e99-aee0-0b7f62b03976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:04 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'pci_devices' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:45:05 user nova-compute[72724]:   <uuid>5012ca5f-ac70-4e99-aee0-0b7f62b03976</uuid>
Aug 17 16:45:05 user nova-compute[72724]:   <name>instance-0000001f</name>
Aug 17 16:45:05 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:45:05 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:45:05 user nova-compute[72724]:   <metadata>
Aug 17 16:45:05 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:45:05 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:45:05 user nova-compute[72724]:       <nova:name>tempest-TestMinimumBasicScenario-server-1801938598</nova:name>
Aug 17 16:45:05 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:45:03</nova:creationTime>
Aug 17 16:45:05 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:45:05 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:45:05 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:45:05 user nova-compute[72724]:       <nova:owner>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:user uuid="cfbf2f6beaf44499a30c0a989459ffc8">tempest-TestMinimumBasicScenario-1956650041-project-member</nova:user>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:project uuid="3d8ad21c16ee4a04a83d6e0261f7d0c8">tempest-TestMinimumBasicScenario-1956650041</nova:project>
Aug 17 16:45:05 user nova-compute[72724]:       </nova:owner>
Aug 17 16:45:05 user nova-compute[72724]:       <nova:root type="image" uuid="576ec697-ffbb-4bc4-9257-36a5c3f27d26"/>
Aug 17 16:45:05 user nova-compute[72724]:       <nova:ports>
Aug 17 16:45:05 user nova-compute[72724]:         <nova:port uuid="d5e6379b-914b-4c8f-8e27-931b973720fd">
Aug 17 16:45:05 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 16:45:05 user nova-compute[72724]:         </nova:port>
Aug 17 16:45:05 user nova-compute[72724]:       </nova:ports>
Aug 17 16:45:05 user nova-compute[72724]:     </nova:instance>
Aug 17 16:45:05 user nova-compute[72724]:   </metadata>
Aug 17 16:45:05 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:45:05 user nova-compute[72724]:     <system>
Aug 17 16:45:05 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:45:05 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:45:05 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:45:05 user nova-compute[72724]:       <entry name="serial">5012ca5f-ac70-4e99-aee0-0b7f62b03976</entry>
Aug 17 16:45:05 user nova-compute[72724]:       <entry name="uuid">5012ca5f-ac70-4e99-aee0-0b7f62b03976</entry>
Aug 17 16:45:05 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:45:05 user nova-compute[72724]:     </system>
Aug 17 16:45:05 user nova-compute[72724]:   </sysinfo>
Aug 17 16:45:05 user nova-compute[72724]:   <os>
Aug 17 16:45:05 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:45:05 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:45:05 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:45:05 user nova-compute[72724]:   </os>
Aug 17 16:45:05 user nova-compute[72724]:   <features>
Aug 17 16:45:05 user nova-compute[72724]:     <acpi/>
Aug 17 16:45:05 user nova-compute[72724]:     <apic/>
Aug 17 16:45:05 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:45:05 user nova-compute[72724]:   </features>
Aug 17 16:45:05 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:45:05 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:45:05 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:45:05 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:45:05 user nova-compute[72724]:   </clock>
Aug 17 16:45:05 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:45:05 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:45:05 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:45:05 user nova-compute[72724]:   </cpu>
Aug 17 16:45:05 user nova-compute[72724]:   <devices>
Aug 17 16:45:05 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:45:05 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:45:05 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk"/>
Aug 17 16:45:05 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:45:05 user nova-compute[72724]:     </disk>
Aug 17 16:45:05 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:45:05 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:45:05 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:45:05 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:45:05 user nova-compute[72724]:       <serial>ed5f8b32-72f7-4163-a17b-e20b770003fc</serial>
Aug 17 16:45:05 user nova-compute[72724]:     </disk>
Aug 17 16:45:05 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:45:05 user nova-compute[72724]:       <mac address="fa:16:3e:21:1b:57"/>
Aug 17 16:45:05 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:45:05 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:45:05 user nova-compute[72724]:       <target dev="tapd5e6379b-91"/>
Aug 17 16:45:05 user nova-compute[72724]:     </interface>
Aug 17 16:45:05 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:45:05 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/console.log" append="off"/>
Aug 17 16:45:05 user nova-compute[72724]:     </serial>
Aug 17 16:45:05 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:45:05 user nova-compute[72724]:     <video>
Aug 17 16:45:05 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:45:05 user nova-compute[72724]:     </video>
Aug 17 16:45:05 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:45:05 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:45:05 user nova-compute[72724]:     </rng>
Aug 17 16:45:05 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:45:05 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:45:05 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:45:05 user nova-compute[72724]:     </memballoon>
Aug 17 16:45:05 user nova-compute[72724]:   </devices>
Aug 17 16:45:05 user nova-compute[72724]: </domain>
Aug 17 16:45:05 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Cannot resize image /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'migration_context' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1801938598',display_name='tempest-TestMinimumBasicScenario-server-1801938598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1801938598',id=31,image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0WplzuawlQ0rQDblM5YOjsDODZzzt1xrC2yLoGgEjU3cZkMyAHyLJoTmYk0FTsd7v0h9ASKP797wdyu+pV0R6Wg+MGZQxHOz9CJLAS4f/i2Am71mOMAzY5wwv3M4P7g==',key_name='tempest-TestMinimumBasicScenario-2050484145',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-9f2eo0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:45:02Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=5012ca5f-ac70-4e99-aee0-0b7f62b03976,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG os_vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd5e6379b-91, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd5e6379b-91, col_values=(('external_ids', {'iface-id': 'd5e6379b-914b-4c8f-8e27-931b973720fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:1b:57', 'vm-uuid': '5012ca5f-ac70-4e99-aee0-0b7f62b03976'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:05 user nova-compute[72724]: INFO os_vif [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91')
Aug 17 16:45:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-58207d8e-f9e4-45e8-b76c-6268d9d1aeb9 req-cbbded7c-2045-4050-8200-6ad27b098fde service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-58207d8e-f9e4-45e8-b76c-6268d9d1aeb9 req-cbbded7c-2045-4050-8200-6ad27b098fde service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-58207d8e-f9e4-45e8-b76c-6268d9d1aeb9 req-cbbded7c-2045-4050-8200-6ad27b098fde service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-58207d8e-f9e4-45e8-b76c-6268d9d1aeb9 req-cbbded7c-2045-4050-8200-6ad27b098fde service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-58207d8e-f9e4-45e8-b76c-6268d9d1aeb9 req-cbbded7c-2045-4050-8200-6ad27b098fde service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:06 user nova-compute[72724]: WARNING nova.compute.manager [req-58207d8e-f9e4-45e8-b76c-6268d9d1aeb9 req-cbbded7c-2045-4050-8200-6ad27b098fde service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state active and task_state reboot_started_hard.
Aug 17 16:45:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-4625d863-652d-45af-9215-3ba14a7f2137 req-ca670550-7e38-4860-9684-308302bdbebc service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4625d863-652d-45af-9215-3ba14a7f2137 req-ca670550-7e38-4860-9684-308302bdbebc service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4625d863-652d-45af-9215-3ba14a7f2137 req-ca670550-7e38-4860-9684-308302bdbebc service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4625d863-652d-45af-9215-3ba14a7f2137 req-ca670550-7e38-4860-9684-308302bdbebc service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-4625d863-652d-45af-9215-3ba14a7f2137 req-ca670550-7e38-4860-9684-308302bdbebc service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:06 user nova-compute[72724]: WARNING nova.compute.manager [req-4625d863-652d-45af-9215-3ba14a7f2137 req-ca670550-7e38-4860-9684-308302bdbebc service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received unexpected event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with vm_state building and task_state spawning.
Aug 17 16:45:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-92d6eb6d-5818-44ff-9aa0-64b1aecfe390 req-e7bcc301-8bbd-4f79-a3c7-95a0e128e386 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-92d6eb6d-5818-44ff-9aa0-64b1aecfe390 req-e7bcc301-8bbd-4f79-a3c7-95a0e128e386 service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-92d6eb6d-5818-44ff-9aa0-64b1aecfe390 req-e7bcc301-8bbd-4f79-a3c7-95a0e128e386 service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-92d6eb6d-5818-44ff-9aa0-64b1aecfe390 req-e7bcc301-8bbd-4f79-a3c7-95a0e128e386 service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-92d6eb6d-5818-44ff-9aa0-64b1aecfe390 req-e7bcc301-8bbd-4f79-a3c7-95a0e128e386 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:08 user nova-compute[72724]: WARNING nova.compute.manager [req-92d6eb6d-5818-44ff-9aa0-64b1aecfe390 req-e7bcc301-8bbd-4f79-a3c7-95a0e128e386 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received unexpected event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with vm_state building and task_state spawning.
Aug 17 16:45:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:08 user nova-compute[72724]: WARNING nova.compute.manager [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state active and task_state reboot_started_hard.
Aug 17 16:45:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:08 user nova-compute[72724]: WARNING nova.compute.manager [req-d17234e9-8a3e-4c99-9ba6-ed773011b851 req-7013765c-bd36-4266-9eab-bdd1f6b12644 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state active and task_state reboot_started_hard.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290709.1520119, e0589f44-f104-4dd8-adca-f097d48d1fe5 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] VM Resumed (Lifecycle Event)
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Instance spawned successfully.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290709.1534154, e0589f44-f104-4dd8-adca-f097d48d1fe5 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] VM Started (Lifecycle Event)
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Took 7.42 seconds to spawn the instance on the hypervisor.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Took 8.06 seconds to build instance.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5f5bdde9-997e-45d0-a363-3e617e8db78f tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.153s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 5012ca5f-ac70-4e99-aee0-0b7f62b03976 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290709.6372664, 5012ca5f-ac70-4e99-aee0-0b7f62b03976 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] VM Resumed (Lifecycle Event)
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance rebooted successfully.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290709.6412983, 5012ca5f-ac70-4e99-aee0-0b7f62b03976 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:09 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] VM Started (Lifecycle Event)
Aug 17 16:45:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c6421260-38d5-4a1e-bfa0-b8011552b168 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.226s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:45:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:45:15 user nova-compute[72724]: INFO nova.compute.claims [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Claim successful on node user
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:45:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:45:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.policy [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26ec3b8cc43c4de7af3b832b45ae4354', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e792bbdb961424893202703ef86bb37', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:45:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Creating image(s)
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.214s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk 1073741824" returned: 0 in 0.054s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Successfully created port: d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Cannot resize image /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'migration_context' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Ensure instance console log exists: /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Successfully updated port: d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-changed-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Refreshing instance network info cache due to event network-changed-d2297e04-bfc4-4316-8e25-86aa3fa0d480. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:45:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance network_info: |[{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.neutron [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Refreshing network info cache for port d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start _get_guest_xml network_info=[{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:45:18 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:18 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'pci_devices' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:45:18 user nova-compute[72724]:   <uuid>ecfe929f-699c-458f-85ef-e55a6503f73f</uuid>
Aug 17 16:45:18 user nova-compute[72724]:   <name>instance-00000021</name>
Aug 17 16:45:18 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:45:18 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:45:18 user nova-compute[72724]:   <metadata>
Aug 17 16:45:18 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:45:18 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:45:18 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherB-server-461911821</nova:name>
Aug 17 16:45:18 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:45:18</nova:creationTime>
Aug 17 16:45:18 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:45:18 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:45:18 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:45:18 user nova-compute[72724]:       <nova:owner>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:user uuid="26ec3b8cc43c4de7af3b832b45ae4354">tempest-ServerActionsTestOtherB-586663785-project-member</nova:user>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:project uuid="5e792bbdb961424893202703ef86bb37">tempest-ServerActionsTestOtherB-586663785</nova:project>
Aug 17 16:45:18 user nova-compute[72724]:       </nova:owner>
Aug 17 16:45:18 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:45:18 user nova-compute[72724]:       <nova:ports>
Aug 17 16:45:18 user nova-compute[72724]:         <nova:port uuid="d2297e04-bfc4-4316-8e25-86aa3fa0d480">
Aug 17 16:45:18 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 16:45:18 user nova-compute[72724]:         </nova:port>
Aug 17 16:45:18 user nova-compute[72724]:       </nova:ports>
Aug 17 16:45:18 user nova-compute[72724]:     </nova:instance>
Aug 17 16:45:18 user nova-compute[72724]:   </metadata>
Aug 17 16:45:18 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:45:18 user nova-compute[72724]:     <system>
Aug 17 16:45:18 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:45:18 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:45:18 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:45:18 user nova-compute[72724]:       <entry name="serial">ecfe929f-699c-458f-85ef-e55a6503f73f</entry>
Aug 17 16:45:18 user nova-compute[72724]:       <entry name="uuid">ecfe929f-699c-458f-85ef-e55a6503f73f</entry>
Aug 17 16:45:18 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:45:18 user nova-compute[72724]:     </system>
Aug 17 16:45:18 user nova-compute[72724]:   </sysinfo>
Aug 17 16:45:18 user nova-compute[72724]:   <os>
Aug 17 16:45:18 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:45:18 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:45:18 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:45:18 user nova-compute[72724]:   </os>
Aug 17 16:45:18 user nova-compute[72724]:   <features>
Aug 17 16:45:18 user nova-compute[72724]:     <acpi/>
Aug 17 16:45:18 user nova-compute[72724]:     <apic/>
Aug 17 16:45:18 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:45:18 user nova-compute[72724]:   </features>
Aug 17 16:45:18 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:45:18 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:45:18 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:45:18 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:45:18 user nova-compute[72724]:   </clock>
Aug 17 16:45:18 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:45:18 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:45:18 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:45:18 user nova-compute[72724]:   </cpu>
Aug 17 16:45:18 user nova-compute[72724]:   <devices>
Aug 17 16:45:18 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:45:18 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:45:18 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk"/>
Aug 17 16:45:18 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:45:18 user nova-compute[72724]:     </disk>
Aug 17 16:45:18 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:45:18 user nova-compute[72724]:       <mac address="fa:16:3e:94:7d:10"/>
Aug 17 16:45:18 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:45:18 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:45:18 user nova-compute[72724]:       <target dev="tapd2297e04-bf"/>
Aug 17 16:45:18 user nova-compute[72724]:     </interface>
Aug 17 16:45:18 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:45:18 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/console.log" append="off"/>
Aug 17 16:45:18 user nova-compute[72724]:     </serial>
Aug 17 16:45:18 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:45:18 user nova-compute[72724]:     <video>
Aug 17 16:45:18 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:45:18 user nova-compute[72724]:     </video>
Aug 17 16:45:18 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:45:18 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:45:18 user nova-compute[72724]:     </rng>
Aug 17 16:45:18 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:45:18 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:45:18 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:45:18 user nova-compute[72724]:     </memballoon>
Aug 17 16:45:18 user nova-compute[72724]:   </devices>
Aug 17 16:45:18 user nova-compute[72724]: </domain>
Aug 17 16:45:18 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG os_vif [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2297e04-bf, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2297e04-bf, col_values=(('external_ids', {'iface-id': 'd2297e04-bfc4-4316-8e25-86aa3fa0d480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:7d:10', 'vm-uuid': 'ecfe929f-699c-458f-85ef-e55a6503f73f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:18 user nova-compute[72724]: INFO os_vif [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf')
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No VIF found with MAC fa:16:3e:94:7d:10, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.neutron [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updated VIF entry in instance network info cache for port d2297e04-bfc4-4316-8e25-86aa3fa0d480. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG nova.network.neutron [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:45:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-597aa120-db49-4cf1-94f8-97192ca505e6 req-5157285c-e25f-4876-b851-efc887c1a9eb service nova] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:45:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-5814b7bc-a9ab-42fd-a2dc-1f28acecf42e req-6bae5e12-2c85-4872-a0e4-773ac47751fa service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5814b7bc-a9ab-42fd-a2dc-1f28acecf42e req-6bae5e12-2c85-4872-a0e4-773ac47751fa service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5814b7bc-a9ab-42fd-a2dc-1f28acecf42e req-6bae5e12-2c85-4872-a0e4-773ac47751fa service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5814b7bc-a9ab-42fd-a2dc-1f28acecf42e req-6bae5e12-2c85-4872-a0e4-773ac47751fa service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-5814b7bc-a9ab-42fd-a2dc-1f28acecf42e req-6bae5e12-2c85-4872-a0e4-773ac47751fa service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:20 user nova-compute[72724]: WARNING nova.compute.manager [req-5814b7bc-a9ab-42fd-a2dc-1f28acecf42e req-6bae5e12-2c85-4872-a0e4-773ac47751fa service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state building and task_state spawning.
Aug 17 16:45:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290722.0238888, ecfe929f-699c-458f-85ef-e55a6503f73f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Resumed (Lifecycle Event)
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance spawned successfully.
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290722.0358539, ecfe929f-699c-458f-85ef-e55a6503f73f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Started (Lifecycle Event)
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-4c5217df-9d2f-43d7-8e93-dddcda0febd7 req-2f4cf486-7126-4b41-aabf-65776dae8ef7 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4c5217df-9d2f-43d7-8e93-dddcda0febd7 req-2f4cf486-7126-4b41-aabf-65776dae8ef7 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4c5217df-9d2f-43d7-8e93-dddcda0febd7 req-2f4cf486-7126-4b41-aabf-65776dae8ef7 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4c5217df-9d2f-43d7-8e93-dddcda0febd7 req-2f4cf486-7126-4b41-aabf-65776dae8ef7 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-4c5217df-9d2f-43d7-8e93-dddcda0febd7 req-2f4cf486-7126-4b41-aabf-65776dae8ef7 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:22 user nova-compute[72724]: WARNING nova.compute.manager [req-4c5217df-9d2f-43d7-8e93-dddcda0febd7 req-2f4cf486-7126-4b41-aabf-65776dae8ef7 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state building and task_state spawning.
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Took 6.21 seconds to spawn the instance on the hypervisor.
Aug 17 16:45:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:22 user nova-compute[72724]: INFO nova.compute.manager [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Took 6.92 seconds to build instance.
Aug 17 16:45:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-100e3681-fd59-4017-8cca-08af11fe928d tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.024s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:31 user nova-compute[72724]: INFO nova.compute.manager [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Terminating instance
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-16a3d84c-7dce-42a2-abcd-30aa32210dc1 req-b6a904e4-5a61-4677-9f1a-a34d60ab5538 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-unplugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-16a3d84c-7dce-42a2-abcd-30aa32210dc1 req-b6a904e4-5a61-4677-9f1a-a34d60ab5538 service nova] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-16a3d84c-7dce-42a2-abcd-30aa32210dc1 req-b6a904e4-5a61-4677-9f1a-a34d60ab5538 service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-16a3d84c-7dce-42a2-abcd-30aa32210dc1 req-b6a904e4-5a61-4677-9f1a-a34d60ab5538 service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-16a3d84c-7dce-42a2-abcd-30aa32210dc1 req-b6a904e4-5a61-4677-9f1a-a34d60ab5538 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] No waiting events found dispatching network-vif-unplugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-16a3d84c-7dce-42a2-abcd-30aa32210dc1 req-b6a904e4-5a61-4677-9f1a-a34d60ab5538 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-unplugged-f0ba7824-6a04-4193-87c4-597b80baab4e for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Instance destroyed successfully.
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.objects.instance [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'resources' on Instance uuid 89d711cf-d3d2-4cfa-9766-eac4523e0f47 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-83258068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-83258068',id=25,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:36:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-rzp67pe7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:38:05Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=89d711cf-d3d2-4cfa-9766-eac4523e0f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "f0ba7824-6a04-4193-87c4-597b80baab4e", "address": "fa:16:3e:37:fd:1a", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ba7824-6a", "ovs_interfaceid": "f0ba7824-6a04-4193-87c4-597b80baab4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG os_vif [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0ba7824-6a, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:31 user nova-compute[72724]: INFO os_vif [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:fd:1a,bridge_name='br-int',has_traffic_filtering=True,id=f0ba7824-6a04-4193-87c4-597b80baab4e,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ba7824-6a')
Aug 17 16:45:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Deleting instance files /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47_del
Aug 17 16:45:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Deletion of /opt/stack/data/nova/instances/89d711cf-d3d2-4cfa-9766-eac4523e0f47_del complete
Aug 17 16:45:31 user nova-compute[72724]: INFO nova.compute.manager [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 17 16:45:31 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:45:31 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:45:32 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Took 0.79 seconds to deallocate network for instance.
Aug 17 16:45:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:45:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:33 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Deleted allocations for instance 89d711cf-d3d2-4cfa-9766-eac4523e0f47
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90d53cfe-ee39-4a8f-862b-30a27bf30fb5 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.108s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] No waiting events found dispatching network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:33 user nova-compute[72724]: WARNING nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received unexpected event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e for instance with vm_state deleted and task_state None.
Aug 17 16:45:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] Acquiring lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] Lock "89d711cf-d3d2-4cfa-9766-eac4523e0f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] No waiting events found dispatching network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:45:33 user nova-compute[72724]: WARNING nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received unexpected event network-vif-plugged-f0ba7824-6a04-4193-87c4-597b80baab4e for instance with vm_state deleted and task_state None.
Aug 17 16:45:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-6f0f668b-6e93-4434-a82d-3072b0c2cbd2 req-55554fac-e232-4413-8a35-dc1b4e3b9878 service nova] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Received event network-vif-deleted-f0ba7824-6a04-4193-87c4-597b80baab4e {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:45:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:46 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290731.7842147, 89d711cf-d3d2-4cfa-9766-eac4523e0f47 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:45:46 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] VM Stopped (Lifecycle Event)
Aug 17 16:45:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cf6d2e2b-cf84-4351-8f94-7c4b29a7d9a7 None None] [instance: 89d711cf-d3d2-4cfa-9766-eac4523e0f47] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:45:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:45:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:45:50 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:50 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8272MB free_disk=25.340740203857422GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 00db2a89-a70b-461d-a887-ccba383edce6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e0589f44-f104-4dd8-adca-f097d48d1fe5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:45:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:45:51 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:45:51 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:45:51 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:45:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.319s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:45:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:45:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:45:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:45:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:45:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:45:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:45:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:45:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:46:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:46:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:46:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:46:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:46:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:46:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "00db2a89-a70b-461d-a887-ccba383edce6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:21 user nova-compute[72724]: INFO nova.compute.manager [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Terminating instance
Aug 17 16:46:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-b296cd33-8e57-4c3e-81b2-7f0b0bd5d7f1 req-cd00d6ba-a6c3-4e22-9d63-0f04db6dd745 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b296cd33-8e57-4c3e-81b2-7f0b0bd5d7f1 req-cd00d6ba-a6c3-4e22-9d63-0f04db6dd745 service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b296cd33-8e57-4c3e-81b2-7f0b0bd5d7f1 req-cd00d6ba-a6c3-4e22-9d63-0f04db6dd745 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b296cd33-8e57-4c3e-81b2-7f0b0bd5d7f1 req-cd00d6ba-a6c3-4e22-9d63-0f04db6dd745 service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-b296cd33-8e57-4c3e-81b2-7f0b0bd5d7f1 req-cd00d6ba-a6c3-4e22-9d63-0f04db6dd745 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-b296cd33-8e57-4c3e-81b2-7f0b0bd5d7f1 req-cd00d6ba-a6c3-4e22-9d63-0f04db6dd745 service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-unplugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:22 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Instance destroyed successfully.
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'resources' on Instance uuid 00db2a89-a70b-461d-a887-ccba383edce6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:30:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1896005839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1896005839',id=21,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-62umgiej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:34:22Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=00db2a89-a70b-461d-a887-ccba383edce6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "address": "fa:16:3e:13:fa:22", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9fc55f1-b4", "ovs_interfaceid": "c9fc55f1-b4a3-440b-ba17-6f355d32a6e3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_vif [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9fc55f1-b4, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:22 user nova-compute[72724]: INFO os_vif [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:fa:22,bridge_name='br-int',has_traffic_filtering=True,id=c9fc55f1-b4a3-440b-ba17-6f355d32a6e3,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9fc55f1-b4')
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEvpKgFh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:46:22 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[092d085a-a568-464b-8670-3f690227dc49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a727a09-5e8d-4dd3-872f-7064644af2f8]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:46:22 user nova-compute[72724]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:46:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 (non-flash)
Aug 17 16:46:22 user nova-compute[72724]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:46:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8599090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0c33ed-e1fa-46ce-a4aa-928712da63fb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a65db5-b768-481d-86ee-fb467609eaf2]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f8df5b-9fec-4827-9211-619a179179a5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d796b7-b7f7-4800-a627-4f319b94770f]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e2ac78-823d-4ecb-b745-7cddcd1ac4e9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bed634c-6e90-4c24-8d00-a98a0032ce63]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260]
Aug 17 16:46:22 user nova-compute[72724]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0, portal: 172.16.0.220,3260] successful.
Aug 17 16:46:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd34f121-b812-4905-accc-e750f539f8a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e74ace9-5737-49cb-b466-e6f531985fc6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] <== disconnect_volume: return (268ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:46:22 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Deleting instance files /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6_del
Aug 17 16:46:22 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Deletion of /opt/stack/data/nova/instances/00db2a89-a70b-461d-a887-ccba383edce6_del complete
Aug 17 16:46:22 user nova-compute[72724]: INFO nova.compute.manager [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 16:46:22 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:46:22 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:46:23 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:46:23 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Took 0.48 seconds to deallocate network for instance.
Aug 17 16:46:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:46:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] Acquiring lock "00db2a89-a70b-461d-a887-ccba383edce6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] Lock "00db2a89-a70b-461d-a887-ccba383edce6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] No waiting events found dispatching network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:46:23 user nova-compute[72724]: WARNING nova.compute.manager [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received unexpected event network-vif-plugged-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 for instance with vm_state active and task_state deleting.
Aug 17 16:46:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-b39bddc3-a7e8-4658-b491-cc74a34efb6e req-0ca40b40-f675-4a63-91a2-18b6b98b577b service nova] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Received event network-vif-deleted-c9fc55f1-b4a3-440b-ba17-6f355d32a6e3 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:46:23 user nova-compute[72724]: INFO nova.compute.manager [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Took 0.77 seconds to detach 1 volumes for instance.
Aug 17 16:46:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:46:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:46:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:24 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Deleted allocations for instance 00db2a89-a70b-461d-a887-ccba383edce6
Aug 17 16:46:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cb5f58c7-e0ac-4e19-af93-0c57cdefcbd9 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "00db2a89-a70b-461d-a887-ccba383edce6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.741s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290782.2540364, 00db2a89-a70b-461d-a887-ccba383edce6 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:46:37 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] VM Stopped (Lifecycle Event)
Aug 17 16:46:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4b06f8d8-0663-4cb0-a995-65a010742703 None None] [instance: 00db2a89-a70b-461d-a887-ccba383edce6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:46:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:46:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:46:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 333d38b1-26ec-4bd1-82d3-da202f339acb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [{"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-333d38b1-26ec-4bd1-82d3-da202f339acb" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:52 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:46:52 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8478MB free_disk=25.339672088623047GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-changed-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Refreshing instance network info cache due to event network-changed-b6cc95c9-50ba-4713-82dc-a89a9e446515. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] Acquiring lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] Acquired lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Refreshing network info cache for port b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 333d38b1-26ec-4bd1-82d3-da202f339acb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e0589f44-f104-4dd8-adca-f097d48d1fe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updated VIF entry in instance network info cache for port b6cc95c9-50ba-4713-82dc-a89a9e446515. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updating instance_info_cache with network_info: [{"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:46:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-92914294-7b8f-4fe7-80df-3d78c54c7075 req-8370f99d-601f-4873-8ace-5a8382c62fc9 service nova] Releasing lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:46:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:46:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:46:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing instance network info cache due to event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing instance network info cache due to event network-changed-d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:46:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updated VIF entry in instance network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2ce97ddf-3080-4807-8d90-fccf64f4bd07 req-5ed6826e-889b-4c0d-b0e7-6f7b8efc82ce service nova] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Refreshing network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:55 user nova-compute[72724]: INFO nova.compute.manager [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Detaching volume ed5f8b32-72f7-4163-a17b-e20b770003fc
Aug 17 16:46:55 user nova-compute[72724]: INFO nova.virt.block_device [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Attempting to driver detach volume ed5f8b32-72f7-4163-a17b-e20b770003fc from mountpoint /dev/vdb
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Attempting to detach device vdb from instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:46:55 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:46:55 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:46:55 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:46:55 user nova-compute[72724]:   <serial>ed5f8b32-72f7-4163-a17b-e20b770003fc</serial>
Aug 17 16:46:55 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 16:46:55 user nova-compute[72724]: </disk>
Aug 17 16:46:55 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:46:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully detached device vdb from instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 from the persistent domain config.
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:46:55 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:46:55 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:46:55 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:46:55 user nova-compute[72724]:   <serial>ed5f8b32-72f7-4163-a17b-e20b770003fc</serial>
Aug 17 16:46:55 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 16:46:55 user nova-compute[72724]: </disk>
Aug 17 16:46:55 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updated VIF entry in instance network info cache for port d5e6379b-914b-4c8f-8e27-931b973720fd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4ef561b1-f842-4426-bad0-f4225439571f req-cd5d5651-f7f1-4353-99f2-a30231d510eb service nova] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290815.9144316, 5012ca5f-ac70-4e99-aee0-0b7f62b03976 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:46:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully detached device vdb from instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 from the live domain config.
Aug 17 16:46:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PrksjpeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:46:55 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6382fb00-84a1-4703-96b3-db92cf56cec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[886de867-a0a2-466a-92b3-9d65402b53cb]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:46:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc (non-flash)
Aug 17 16:46:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e83ae200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a6f5ae-9299-4281-abe7-b950bd55e207]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f617c6b0-7bcc-4d44-96e0-755f06836277]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[926e50ec-353a-4a0b-a542-02ca9f89e6e3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9bc36c-deef-44b5-9def-509822e80dfd]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f716d97b-88eb-4f74-a01c-37eb90c62843]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5b4a9d-a941-4e37-bb9c-b003e6c3ec20]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260]
Aug 17 16:46:56 user nova-compute[72724]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc, portal: 172.16.0.220,3260] successful.
Aug 17 16:46:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed5f8b32-72f7-4163-a17b-e20b770003fc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e53bad4-8315-4c38-b95e-1ead4ffb9c2c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.251s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== disconnect_volume: return (253ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:46:56 user nova-compute[72724]: INFO nova.compute.manager [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Attaching volume 14701a84-12d4-49ad-90df-16a9d91b1fa0 to /dev/vdb
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.utils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab16562-3929-4dbe-ae88-e23cbee6778f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[692f1afc-817e-477c-b4ca-e68ca346f139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dbdbd9-a64f-4c23-9d23-f5bae53ec79a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa119f0e-0730-4a34-9b59-a83b12fd119e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:46:56 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:46:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1257b593-f400-4ec6-8b97-960d5a3eeb87]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG os_brick.utils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updating existing volume attachment record: e8452506-a242-4f13-8dd2-a07f58eaf8ab {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'flavor' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-920c3e43-dae6-4bbb-aeaa-4b7859cc7ec1 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.827s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:46:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-changed-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Refreshing instance network info cache due to event network-changed-d2297e04-bfc4-4316-8e25-86aa3fa0d480. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Refreshing network info cache for port d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXGKrodB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:47:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:47:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:47:06 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[763f6942-7ee6-4c24-bb71-1ab32adab6b4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:47:06 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd776b3d-147b-468b-8908-0598dc9092a9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0] added
Aug 17 16:47:06 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f52a0ef-d1b4-42ce-99e8-abc0f001971f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c53487-d907-4dc9-9efd-1f064f749932]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXGKrodB {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yXGKrodB" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c1bbe6-d34a-429d-98df-4e70a997884f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yXGKrodB'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c25e2a-f7c9-42cf-a1a5-751fd98092f1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2f9ebb-d111-449f-b8f7-dd0df92600a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:47:07 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:47:07 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:47:07 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 16:47:07 user nova-compute[72724]: 
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[172021fa-e1e2-46a2-8304-2e517d2dd6a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260]
Aug 17 16:47:07 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260] successful.
Aug 17 16:47:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updated VIF entry in instance network info cache for port d2297e04-bfc4-4316-8e25-86aa3fa0d480. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da120ee-3fd9-4eb9-833a-409c05adaaa5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f86faa62-e643-4f72-bae8-99ad7ccba9da req-641de6da-8b59-4b9f-8eb7-0b0ebb6adeb6 service nova] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab6b769-19a2-4bc6-b8a5-7e3819f2e9ac]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:47:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:47:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9629cb9d-3050-4183-b1bb-b9276bb0434c]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:47:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXGKrodB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== connect_volume: return (1293ms) {'type': 'block', 'scsi_wwn': '26135613066616465', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135613066616465', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:47:08 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:47:08 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:47:08 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:47:08 user nova-compute[72724]:   <serial>14701a84-12d4-49ad-90df-16a9d91b1fa0</serial>
Aug 17 16:47:08 user nova-compute[72724]: </disk>
Aug 17 16:47:08 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:41:9a:a0, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:47:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2962bfc5-0597-4d2d-9725-ea919009da2d tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.990s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.013s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:12 user nova-compute[72724]: INFO nova.compute.manager [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Terminating instance
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-0c4931f4-b44f-488d-8c67-79547f94e65c req-3ac34b39-cba2-43d4-8071-683669aebe7a service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-vif-unplugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0c4931f4-b44f-488d-8c67-79547f94e65c req-3ac34b39-cba2-43d4-8071-683669aebe7a service nova] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0c4931f4-b44f-488d-8c67-79547f94e65c req-3ac34b39-cba2-43d4-8071-683669aebe7a service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0c4931f4-b44f-488d-8c67-79547f94e65c req-3ac34b39-cba2-43d4-8071-683669aebe7a service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-0c4931f4-b44f-488d-8c67-79547f94e65c req-3ac34b39-cba2-43d4-8071-683669aebe7a service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] No waiting events found dispatching network-vif-unplugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-0c4931f4-b44f-488d-8c67-79547f94e65c req-3ac34b39-cba2-43d4-8071-683669aebe7a service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-vif-unplugged-989c4b5f-3118-449f-b950-a06df2ef7b3d for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:47:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Instance destroyed successfully.
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lazy-loading 'resources' on Instance uuid 333d38b1-26ec-4bd1-82d3-da202f339acb {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1904099515',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1904099515',id=16,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:27:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2796590bb0c43479a3e82c1c4c836b0',ramdisk_id='',reservation_id='r-aa2v9rmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:29:33Z,user_data=None,user_id='9c4b6bc314a140e0a5f12ecfbb43450f',uuid=333d38b1-26ec-4bd1-82d3-da202f339acb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converting VIF {"id": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "address": "fa:16:3e:e4:0c:0c", "network": {"id": "fd40b1ef-0d0a-4dce-a718-aab126d1eb51", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-2132751855-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2796590bb0c43479a3e82c1c4c836b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989c4b5f-31", "ovs_interfaceid": "989c4b5f-3118-449f-b950-a06df2ef7b3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG os_vif [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap989c4b5f-31, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:47:12 user nova-compute[72724]: INFO os_vif [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:0c:0c,bridge_name='br-int',has_traffic_filtering=True,id=989c4b5f-3118-449f-b950-a06df2ef7b3d,network=Network(fd40b1ef-0d0a-4dce-a718-aab126d1eb51),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989c4b5f-31')
Aug 17 16:47:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Deleting instance files /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb_del
Aug 17 16:47:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Deletion of /opt/stack/data/nova/instances/333d38b1-26ec-4bd1-82d3-da202f339acb_del complete
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "fe3ef284-6596-4864-8a04-2327e83b929f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:47:13 user nova-compute[72724]: INFO nova.compute.manager [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:47:13 user nova-compute[72724]: INFO nova.compute.claims [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Claim successful on node user
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:47:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbdf21f8-aaf1-4e25-85f8-ecf7cc02a8f5 req-65d565f7-6624-40d3-aff2-e6f4ebc324cc service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-vif-deleted-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:13 user nova-compute[72724]: INFO nova.compute.manager [req-bbdf21f8-aaf1-4e25-85f8-ecf7cc02a8f5 req-65d565f7-6624-40d3-aff2-e6f4ebc324cc service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Neutron deleted interface 989c4b5f-3118-449f-b950-a06df2ef7b3d; detaching it from the instance and deleting it from the info cache
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.network.neutron [req-bbdf21f8-aaf1-4e25-85f8-ecf7cc02a8f5 req-65d565f7-6624-40d3-aff2-e6f4ebc324cc service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.policy [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05a8d77a3b04cc783d6ef9fdea15526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d8a38870654abe8b40aeb3ee406293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:47:13 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Took 0.55 seconds to deallocate network for instance.
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbdf21f8-aaf1-4e25-85f8-ecf7cc02a8f5 req-65d565f7-6624-40d3-aff2-e6f4ebc324cc service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Detach interface failed, port_id=989c4b5f-3118-449f-b950-a06df2ef7b3d, reason: Instance 333d38b1-26ec-4bd1-82d3-da202f339acb could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:47:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Creating image(s)
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "/opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:47:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.267s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:14 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Deleted allocations for instance 333d38b1-26ec-4bd1-82d3-da202f339acb
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk 1073741824" returned: 0 in 0.052s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d431df4c-3905-4d41-b071-26393d110780 tempest-ServerBootFromVolumeStableRescueTest-1911010508 tempest-ServerBootFromVolumeStableRescueTest-1911010508-project-member] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.936s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Cannot resize image /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'migration_context' on Instance uuid fe3ef284-6596-4864-8a04-2327e83b929f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Ensure instance console log exists: /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Successfully created port: f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-5d2d55f5-7127-4c0d-b974-82a77fff6d54 req-011011f9-9611-4d5c-a15c-cd81ce2eae96 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received event network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5d2d55f5-7127-4c0d-b974-82a77fff6d54 req-011011f9-9611-4d5c-a15c-cd81ce2eae96 service nova] Acquiring lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5d2d55f5-7127-4c0d-b974-82a77fff6d54 req-011011f9-9611-4d5c-a15c-cd81ce2eae96 service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5d2d55f5-7127-4c0d-b974-82a77fff6d54 req-011011f9-9611-4d5c-a15c-cd81ce2eae96 service nova] Lock "333d38b1-26ec-4bd1-82d3-da202f339acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-5d2d55f5-7127-4c0d-b974-82a77fff6d54 req-011011f9-9611-4d5c-a15c-cd81ce2eae96 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] No waiting events found dispatching network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:47:14 user nova-compute[72724]: WARNING nova.compute.manager [req-5d2d55f5-7127-4c0d-b974-82a77fff6d54 req-011011f9-9611-4d5c-a15c-cd81ce2eae96 service nova] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Received unexpected event network-vif-plugged-989c4b5f-3118-449f-b950-a06df2ef7b3d for instance with vm_state deleted and task_state None.
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Successfully updated port: f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquired lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Updating instance_info_cache with network_info: [{"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Releasing lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Instance network_info: |[{"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Start _get_guest_xml network_info=[{"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:47:15 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:47:15 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-790249313',display_name='tempest-AttachVolumeNegativeTest-server-790249313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-790249313',id=34,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQmhdlSQcRngHaz3pCshs/Vik7DNYdsors7ovrYl3klSIaCpvDb8WJ8KdIbaHy2WbosRFxHJFN1jbvgxf4wo6ionkEw9bVI4W+G/TvDXd/L+I7+4wtIt9K4/cBvTP5RHg==',key_name='tempest-keypair-2123003901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-jtyeb59w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=fe3ef284-6596-4864-8a04-2327e83b929f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'pci_devices' on Instance uuid fe3ef284-6596-4864-8a04-2327e83b929f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:47:15 user nova-compute[72724]:   <uuid>fe3ef284-6596-4864-8a04-2327e83b929f</uuid>
Aug 17 16:47:15 user nova-compute[72724]:   <name>instance-00000022</name>
Aug 17 16:47:15 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:47:15 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:47:15 user nova-compute[72724]:   <metadata>
Aug 17 16:47:15 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:47:15 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:47:15 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeNegativeTest-server-790249313</nova:name>
Aug 17 16:47:15 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:47:15</nova:creationTime>
Aug 17 16:47:15 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:47:15 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:47:15 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:47:15 user nova-compute[72724]:       <nova:owner>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:user uuid="d05a8d77a3b04cc783d6ef9fdea15526">tempest-AttachVolumeNegativeTest-1491105836-project-member</nova:user>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:project uuid="d5d8a38870654abe8b40aeb3ee406293">tempest-AttachVolumeNegativeTest-1491105836</nova:project>
Aug 17 16:47:15 user nova-compute[72724]:       </nova:owner>
Aug 17 16:47:15 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:47:15 user nova-compute[72724]:       <nova:ports>
Aug 17 16:47:15 user nova-compute[72724]:         <nova:port uuid="f9863a84-76b0-4818-a1e2-6accee0ca226">
Aug 17 16:47:15 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 16:47:15 user nova-compute[72724]:         </nova:port>
Aug 17 16:47:15 user nova-compute[72724]:       </nova:ports>
Aug 17 16:47:15 user nova-compute[72724]:     </nova:instance>
Aug 17 16:47:15 user nova-compute[72724]:   </metadata>
Aug 17 16:47:15 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:47:15 user nova-compute[72724]:     <system>
Aug 17 16:47:15 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:47:15 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:47:15 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:47:15 user nova-compute[72724]:       <entry name="serial">fe3ef284-6596-4864-8a04-2327e83b929f</entry>
Aug 17 16:47:15 user nova-compute[72724]:       <entry name="uuid">fe3ef284-6596-4864-8a04-2327e83b929f</entry>
Aug 17 16:47:15 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:47:15 user nova-compute[72724]:     </system>
Aug 17 16:47:15 user nova-compute[72724]:   </sysinfo>
Aug 17 16:47:15 user nova-compute[72724]:   <os>
Aug 17 16:47:15 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:47:15 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:47:15 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:47:15 user nova-compute[72724]:   </os>
Aug 17 16:47:15 user nova-compute[72724]:   <features>
Aug 17 16:47:15 user nova-compute[72724]:     <acpi/>
Aug 17 16:47:15 user nova-compute[72724]:     <apic/>
Aug 17 16:47:15 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:47:15 user nova-compute[72724]:   </features>
Aug 17 16:47:15 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:47:15 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:47:15 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:47:15 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:47:15 user nova-compute[72724]:   </clock>
Aug 17 16:47:15 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:47:15 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:47:15 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:47:15 user nova-compute[72724]:   </cpu>
Aug 17 16:47:15 user nova-compute[72724]:   <devices>
Aug 17 16:47:15 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:47:15 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:47:15 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk"/>
Aug 17 16:47:15 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:47:15 user nova-compute[72724]:     </disk>
Aug 17 16:47:15 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:47:15 user nova-compute[72724]:       <mac address="fa:16:3e:89:99:89"/>
Aug 17 16:47:15 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:47:15 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:47:15 user nova-compute[72724]:       <target dev="tapf9863a84-76"/>
Aug 17 16:47:15 user nova-compute[72724]:     </interface>
Aug 17 16:47:15 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:47:15 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/console.log" append="off"/>
Aug 17 16:47:15 user nova-compute[72724]:     </serial>
Aug 17 16:47:15 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:47:15 user nova-compute[72724]:     <video>
Aug 17 16:47:15 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:47:15 user nova-compute[72724]:     </video>
Aug 17 16:47:15 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:47:15 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:47:15 user nova-compute[72724]:     </rng>
Aug 17 16:47:15 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:47:15 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:47:15 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:47:15 user nova-compute[72724]:     </memballoon>
Aug 17 16:47:15 user nova-compute[72724]:   </devices>
Aug 17 16:47:15 user nova-compute[72724]: </domain>
Aug 17 16:47:15 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-790249313',display_name='tempest-AttachVolumeNegativeTest-server-790249313',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-790249313',id=34,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQmhdlSQcRngHaz3pCshs/Vik7DNYdsors7ovrYl3klSIaCpvDb8WJ8KdIbaHy2WbosRFxHJFN1jbvgxf4wo6ionkEw9bVI4W+G/TvDXd/L+I7+4wtIt9K4/cBvTP5RHg==',key_name='tempest-keypair-2123003901',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-jtyeb59w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=fe3ef284-6596-4864-8a04-2327e83b929f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG os_vif [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9863a84-76, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf9863a84-76, col_values=(('external_ids', {'iface-id': 'f9863a84-76b0-4818-a1e2-6accee0ca226', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:99:89', 'vm-uuid': 'fe3ef284-6596-4864-8a04-2327e83b929f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:47:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:15 user nova-compute[72724]: INFO os_vif [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76')
Aug 17 16:47:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:89:99:89, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-changed-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Refreshing instance network info cache due to event network-changed-f9863a84-76b0-4818-a1e2-6accee0ca226. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] Acquiring lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] Acquired lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:47:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Refreshing network info cache for port f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Updated VIF entry in instance network info cache for port f9863a84-76b0-4818-a1e2-6accee0ca226. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Updating instance_info_cache with network_info: [{"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-031f4798-1bcc-4c0a-8945-8773c1bfffa7 req-1a4c9dc8-70f5-4aea-8163-64030232b469 service nova] Releasing lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] No waiting events found dispatching network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:47:18 user nova-compute[72724]: WARNING nova.compute.manager [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received unexpected event network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 for instance with vm_state building and task_state spawning.
Aug 17 16:47:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] No waiting events found dispatching network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:47:18 user nova-compute[72724]: WARNING nova.compute.manager [req-f51bcf05-5598-4741-8638-85a1d168732f req-c8304834-3fb7-4033-a663-d4d08720a5b5 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received unexpected event network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 for instance with vm_state building and task_state spawning.
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290839.4077563, fe3ef284-6596-4864-8a04-2327e83b929f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] VM Resumed (Lifecycle Event)
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Instance spawned successfully.
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290839.409992, fe3ef284-6596-4864-8a04-2327e83b929f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] VM Started (Lifecycle Event)
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 17 16:47:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:47:19 user nova-compute[72724]: INFO nova.compute.manager [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Took 6.51 seconds to build instance.
Aug 17 16:47:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7112f056-08fc-4b6f-bffe-77ce8549cf2c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "fe3ef284-6596-4864-8a04-2327e83b929f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.611s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:27 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290832.9584267, 333d38b1-26ec-4bd1-82d3-da202f339acb => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:47:27 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] VM Stopped (Lifecycle Event)
Aug 17 16:47:27 user nova-compute[72724]: DEBUG nova.compute.manager [None req-36fde83f-1233-4582-ab4b-1dd787d3162b None None] [instance: 333d38b1-26ec-4bd1-82d3-da202f339acb] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:47:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:47:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:47:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:47:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:47:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:47:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:47:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:47:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:47:51 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [{"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-5012ca5f-ac70-4e99-aee0-0b7f62b03976" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:52 user nova-compute[72724]: INFO nova.compute.manager [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Terminating instance
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-45376386-e4b3-4fa4-a53a-edf7a06b7847 req-1bfcb947-8603-4085-ba57-58f1b4992ef9 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-unplugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-45376386-e4b3-4fa4-a53a-edf7a06b7847 req-1bfcb947-8603-4085-ba57-58f1b4992ef9 service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-45376386-e4b3-4fa4-a53a-edf7a06b7847 req-1bfcb947-8603-4085-ba57-58f1b4992ef9 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-45376386-e4b3-4fa4-a53a-edf7a06b7847 req-1bfcb947-8603-4085-ba57-58f1b4992ef9 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-45376386-e4b3-4fa4-a53a-edf7a06b7847 req-1bfcb947-8603-4085-ba57-58f1b4992ef9 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-unplugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:47:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-45376386-e4b3-4fa4-a53a-edf7a06b7847 req-1bfcb947-8603-4085-ba57-58f1b4992ef9 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-unplugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:53 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Instance destroyed successfully.
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'resources' on Instance uuid 5012ca5f-ac70-4e99-aee0-0b7f62b03976 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:42:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1801938598',display_name='tempest-TestMinimumBasicScenario-server-1801938598',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1801938598',id=31,image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAo0WplzuawlQ0rQDblM5YOjsDODZzzt1xrC2yLoGgEjU3cZkMyAHyLJoTmYk0FTsd7v0h9ASKP797wdyu+pV0R6Wg+MGZQxHOz9CJLAS4f/i2Am71mOMAzY5wwv3M4P7g==',key_name='tempest-TestMinimumBasicScenario-2050484145',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:42:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-9f2eo0tt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='576ec697-ffbb-4bc4-9257-36a5c3f27d26',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:45:10Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=5012ca5f-ac70-4e99-aee0-0b7f62b03976,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "d5e6379b-914b-4c8f-8e27-931b973720fd", "address": "fa:16:3e:21:1b:57", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd5e6379b-91", "ovs_interfaceid": "d5e6379b-914b-4c8f-8e27-931b973720fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG os_vif [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd5e6379b-91, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:47:53 user nova-compute[72724]: INFO os_vif [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:1b:57,bridge_name='br-int',has_traffic_filtering=True,id=d5e6379b-914b-4c8f-8e27-931b973720fd,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd5e6379b-91')
Aug 17 16:47:53 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Deleting instance files /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976_del
Aug 17 16:47:53 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Deletion of /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976_del complete
Aug 17 16:47:53 user nova-compute[72724]: INFO nova.compute.manager [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json" returned: 1 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk --force-share --output=json' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:47:53 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-0000001f, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/5012ca5f-ac70-4e99-aee0-0b7f62b03976/disk
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c30e49c-82f4-455b-a858-59c0bdccd79d req-d5f02a52-9542-41ee-836a-a375748a63c4 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-deleted-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:53 user nova-compute[72724]: INFO nova.compute.manager [req-7c30e49c-82f4-455b-a858-59c0bdccd79d req-d5f02a52-9542-41ee-836a-a375748a63c4 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Neutron deleted interface d5e6379b-914b-4c8f-8e27-931b973720fd; detaching it from the instance and deleting it from the info cache
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-7c30e49c-82f4-455b-a858-59c0bdccd79d req-d5f02a52-9542-41ee-836a-a375748a63c4 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:47:53 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Took 0.59 seconds to deallocate network for instance.
Aug 17 16:47:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7c30e49c-82f4-455b-a858-59c0bdccd79d req-d5f02a52-9542-41ee-836a-a375748a63c4 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Detach interface failed, port_id=d5e6379b-914b-4c8f-8e27-931b973720fd, reason: Instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976 could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:47:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:55 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Deleted allocations for instance 5012ca5f-ac70-4e99-aee0-0b7f62b03976
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-8da6b85b-2916-4ee0-a660-957507dc69b3 req-75635a9e-8245-4d66-a26c-806d18e15313 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8da6b85b-2916-4ee0-a660-957507dc69b3 req-75635a9e-8245-4d66-a26c-806d18e15313 service nova] Acquiring lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8da6b85b-2916-4ee0-a660-957507dc69b3 req-75635a9e-8245-4d66-a26c-806d18e15313 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8da6b85b-2916-4ee0-a660-957507dc69b3 req-75635a9e-8245-4d66-a26c-806d18e15313 service nova] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-8da6b85b-2916-4ee0-a660-957507dc69b3 req-75635a9e-8245-4d66-a26c-806d18e15313 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] No waiting events found dispatching network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:47:55 user nova-compute[72724]: WARNING nova.compute.manager [req-8da6b85b-2916-4ee0-a660-957507dc69b3 req-75635a9e-8245-4d66-a26c-806d18e15313 service nova] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Received unexpected event network-vif-plugged-d5e6379b-914b-4c8f-8e27-931b973720fd for instance with vm_state deleted and task_state None.
Aug 17 16:47:55 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:47:55 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8430MB free_disk=25.434356689453125GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c94a619b-4898-4771-86ab-0b3c968bdad9 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "5012ca5f-ac70-4e99-aee0-0b7f62b03976" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.714s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e0589f44-f104-4dd8-adca-f097d48d1fe5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance fe3ef284-6596-4864-8a04-2327e83b929f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:47:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:47:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:47:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:47:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:48:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:08 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290873.1618426, 5012ca5f-ac70-4e99-aee0-0b7f62b03976 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:48:08 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] VM Stopped (Lifecycle Event)
Aug 17 16:48:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2691e174-8365-4705-af15-59f02a3bff5d None None] [instance: 5012ca5f-ac70-4e99-aee0-0b7f62b03976] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:48:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:48:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:48:37 user nova-compute[72724]: INFO nova.compute.claims [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Claim successful on node user
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:48:37 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.policy [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a854ae5c0a943f0a402c4abbbbd5840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5be94c68ab4e7082f8fee463f3eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:48:37 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Creating image(s)
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "/opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "/opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "/opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk 1073741824" returned: 0 in 0.056s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Successfully created port: ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Cannot resize image /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG nova.objects.instance [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lazy-loading 'migration_context' on Instance uuid 328d31f6-66b3-4bba-9091-522bf850ebe9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Ensure instance console log exists: /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Successfully updated port: ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "refresh_cache-328d31f6-66b3-4bba-9091-522bf850ebe9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquired lock "refresh_cache-328d31f6-66b3-4bba-9091-522bf850ebe9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-changed-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Refreshing instance network info cache due to event network-changed-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] Acquiring lock "refresh_cache-328d31f6-66b3-4bba-9091-522bf850ebe9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.neutron [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Updating instance_info_cache with network_info: [{"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Releasing lock "refresh_cache-328d31f6-66b3-4bba-9091-522bf850ebe9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Instance network_info: |[{"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] Acquired lock "refresh_cache-328d31f6-66b3-4bba-9091-522bf850ebe9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.neutron [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Refreshing network info cache for port ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Start _get_guest_xml network_info=[{"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:48:39 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:48:39 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-530149012',display_name='tempest-VolumesActionsTest-instance-530149012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-530149012',id=35,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db5be94c68ab4e7082f8fee463f3eae9',ramdisk_id='',reservation_id='r-cnlu7c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1286366818',owner_user_name='tempest-VolumesActionsTest-1286366818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:48:38Z,user_data=None,user_id='1a854ae5c0a943f0a402c4abbbbd5840',uuid=328d31f6-66b3-4bba-9091-522bf850ebe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converting VIF {"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lazy-loading 'pci_devices' on Instance uuid 328d31f6-66b3-4bba-9091-522bf850ebe9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:48:39 user nova-compute[72724]:   <uuid>328d31f6-66b3-4bba-9091-522bf850ebe9</uuid>
Aug 17 16:48:39 user nova-compute[72724]:   <name>instance-00000023</name>
Aug 17 16:48:39 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:48:39 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:48:39 user nova-compute[72724]:   <metadata>
Aug 17 16:48:39 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:48:39 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:48:39 user nova-compute[72724]:       <nova:name>tempest-VolumesActionsTest-instance-530149012</nova:name>
Aug 17 16:48:39 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:48:39</nova:creationTime>
Aug 17 16:48:39 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:48:39 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:48:39 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:48:39 user nova-compute[72724]:       <nova:owner>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:user uuid="1a854ae5c0a943f0a402c4abbbbd5840">tempest-VolumesActionsTest-1286366818-project-member</nova:user>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:project uuid="db5be94c68ab4e7082f8fee463f3eae9">tempest-VolumesActionsTest-1286366818</nova:project>
Aug 17 16:48:39 user nova-compute[72724]:       </nova:owner>
Aug 17 16:48:39 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:48:39 user nova-compute[72724]:       <nova:ports>
Aug 17 16:48:39 user nova-compute[72724]:         <nova:port uuid="ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299">
Aug 17 16:48:39 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 16:48:39 user nova-compute[72724]:         </nova:port>
Aug 17 16:48:39 user nova-compute[72724]:       </nova:ports>
Aug 17 16:48:39 user nova-compute[72724]:     </nova:instance>
Aug 17 16:48:39 user nova-compute[72724]:   </metadata>
Aug 17 16:48:39 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:48:39 user nova-compute[72724]:     <system>
Aug 17 16:48:39 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:48:39 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:48:39 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:48:39 user nova-compute[72724]:       <entry name="serial">328d31f6-66b3-4bba-9091-522bf850ebe9</entry>
Aug 17 16:48:39 user nova-compute[72724]:       <entry name="uuid">328d31f6-66b3-4bba-9091-522bf850ebe9</entry>
Aug 17 16:48:39 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:48:39 user nova-compute[72724]:     </system>
Aug 17 16:48:39 user nova-compute[72724]:   </sysinfo>
Aug 17 16:48:39 user nova-compute[72724]:   <os>
Aug 17 16:48:39 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:48:39 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:48:39 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:48:39 user nova-compute[72724]:   </os>
Aug 17 16:48:39 user nova-compute[72724]:   <features>
Aug 17 16:48:39 user nova-compute[72724]:     <acpi/>
Aug 17 16:48:39 user nova-compute[72724]:     <apic/>
Aug 17 16:48:39 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:48:39 user nova-compute[72724]:   </features>
Aug 17 16:48:39 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:48:39 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:48:39 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:48:39 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:48:39 user nova-compute[72724]:   </clock>
Aug 17 16:48:39 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:48:39 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:48:39 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:48:39 user nova-compute[72724]:   </cpu>
Aug 17 16:48:39 user nova-compute[72724]:   <devices>
Aug 17 16:48:39 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:48:39 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:48:39 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk"/>
Aug 17 16:48:39 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:48:39 user nova-compute[72724]:     </disk>
Aug 17 16:48:39 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:48:39 user nova-compute[72724]:       <mac address="fa:16:3e:1f:60:3e"/>
Aug 17 16:48:39 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:48:39 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:48:39 user nova-compute[72724]:       <target dev="tapae76a78b-ae"/>
Aug 17 16:48:39 user nova-compute[72724]:     </interface>
Aug 17 16:48:39 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:48:39 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/console.log" append="off"/>
Aug 17 16:48:39 user nova-compute[72724]:     </serial>
Aug 17 16:48:39 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:48:39 user nova-compute[72724]:     <video>
Aug 17 16:48:39 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:48:39 user nova-compute[72724]:     </video>
Aug 17 16:48:39 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:48:39 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:48:39 user nova-compute[72724]:     </rng>
Aug 17 16:48:39 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:48:39 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:48:39 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:48:39 user nova-compute[72724]:     </memballoon>
Aug 17 16:48:39 user nova-compute[72724]:   </devices>
Aug 17 16:48:39 user nova-compute[72724]: </domain>
Aug 17 16:48:39 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-530149012',display_name='tempest-VolumesActionsTest-instance-530149012',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-530149012',id=35,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db5be94c68ab4e7082f8fee463f3eae9',ramdisk_id='',reservation_id='r-cnlu7c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1286366818',owner_user_name='tempest-VolumesActionsTest-1286366818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:48:38Z,user_data=None,user_id='1a854ae5c0a943f0a402c4abbbbd5840',uuid=328d31f6-66b3-4bba-9091-522bf850ebe9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converting VIF {"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG os_vif [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae76a78b-ae, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae76a78b-ae, col_values=(('external_ids', {'iface-id': 'ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:60:3e', 'vm-uuid': '328d31f6-66b3-4bba-9091-522bf850ebe9'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:39 user nova-compute[72724]: INFO os_vif [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae')
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:48:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] No VIF found with MAC fa:16:3e:1f:60:3e, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:48:40 user nova-compute[72724]: DEBUG nova.network.neutron [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Updated VIF entry in instance network info cache for port ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:48:40 user nova-compute[72724]: DEBUG nova.network.neutron [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Updating instance_info_cache with network_info: [{"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:48:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b3b9e96d-72d3-4bcc-b10a-ee832fb71c87 req-0579cce5-1404-42cf-89e0-0d5e0b979bc7 service nova] Releasing lock "refresh_cache-328d31f6-66b3-4bba-9091-522bf850ebe9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-68998f2f-be43-4a43-9b1f-6b13b585614f req-2e423c2b-9d9f-4f4e-835e-aa9174a58fca service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-68998f2f-be43-4a43-9b1f-6b13b585614f req-2e423c2b-9d9f-4f4e-835e-aa9174a58fca service nova] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-68998f2f-be43-4a43-9b1f-6b13b585614f req-2e423c2b-9d9f-4f4e-835e-aa9174a58fca service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-68998f2f-be43-4a43-9b1f-6b13b585614f req-2e423c2b-9d9f-4f4e-835e-aa9174a58fca service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-68998f2f-be43-4a43-9b1f-6b13b585614f req-2e423c2b-9d9f-4f4e-835e-aa9174a58fca service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] No waiting events found dispatching network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:48:41 user nova-compute[72724]: WARNING nova.compute.manager [req-68998f2f-be43-4a43-9b1f-6b13b585614f req-2e423c2b-9d9f-4f4e-835e-aa9174a58fca service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received unexpected event network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 for instance with vm_state building and task_state spawning.
Aug 17 16:48:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290923.2149553, 328d31f6-66b3-4bba-9091-522bf850ebe9 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] VM Resumed (Lifecycle Event)
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Instance spawned successfully.
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290923.2164342, 328d31f6-66b3-4bba-9091-522bf850ebe9 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] VM Started (Lifecycle Event)
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:43 user nova-compute[72724]: INFO nova.compute.manager [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Took 5.91 seconds to build instance.
Aug 17 16:48:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-96a93c5e-e192-486d-9237-f27fc62b8b64 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.009s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-6ad6d9bb-dbe1-43a9-b67c-c17ff2887e8f req-f4a4cfa2-d5ed-4d6b-8f0a-f2d3814d050c service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6ad6d9bb-dbe1-43a9-b67c-c17ff2887e8f req-f4a4cfa2-d5ed-4d6b-8f0a-f2d3814d050c service nova] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6ad6d9bb-dbe1-43a9-b67c-c17ff2887e8f req-f4a4cfa2-d5ed-4d6b-8f0a-f2d3814d050c service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6ad6d9bb-dbe1-43a9-b67c-c17ff2887e8f req-f4a4cfa2-d5ed-4d6b-8f0a-f2d3814d050c service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-6ad6d9bb-dbe1-43a9-b67c-c17ff2887e8f req-f4a4cfa2-d5ed-4d6b-8f0a-f2d3814d050c service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] No waiting events found dispatching network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:48:43 user nova-compute[72724]: WARNING nova.compute.manager [req-6ad6d9bb-dbe1-43a9-b67c-c17ff2887e8f req-f4a4cfa2-d5ed-4d6b-8f0a-f2d3814d050c service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received unexpected event network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 for instance with vm_state active and task_state None.
Aug 17 16:48:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:48:46 user nova-compute[72724]: INFO nova.compute.claims [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Claim successful on node user
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:48:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:48:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG nova.policy [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfbf2f6beaf44499a30c0a989459ffc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d8ad21c16ee4a04a83d6e0261f7d0c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:48:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Creating image(s)
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "/opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "/opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "/opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "ea631c2ac436aa3e55b4e7befd1655ded6d390f8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "ea631c2ac436aa3e55b4e7befd1655ded6d390f8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.part --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG nova.virt.images [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] dc53f958-3e60-4cfd-97ab-fdb07c950d4d was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.part /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:47 user nova-compute[72724]: DEBUG nova.network.neutron [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Successfully created port: 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.part /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.converted" returned: 0 in 0.623s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "ea631c2ac436aa3e55b4e7befd1655ded6d390f8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.630s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "ea631c2ac436aa3e55b4e7befd1655ded6d390f8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "ea631c2ac436aa3e55b4e7befd1655ded6d390f8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:48 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Successfully updated port: 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8,backing_fmt=raw /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.compute.manager [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing instance network info cache due to event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8,backing_fmt=raw /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk 1073741824" returned: 0 in 0.252s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "ea631c2ac436aa3e55b4e7befd1655ded6d390f8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.446s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5ad5b0a-d2fb-4833-b879-3f42b030c065 req-8fc7c3df-145b-4b34-ac88-48600d8a56fd service nova] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Cannot resize image /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'migration_context' on Instance uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Ensure instance console log exists: /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance network_info: |[{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Start _get_guest_xml network_info=[{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:48:44Z,direct_url=<?>,disk_format='qcow2',id=dc53f958-3e60-4cfd-97ab-fdb07c950d4d,min_disk=0,min_ram=0,name='tempest-scenario-img--1518633937',owner='3d8ad21c16ee4a04a83d6e0261f7d0c8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:48:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'dc53f958-3e60-4cfd-97ab-fdb07c950d4d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:48:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:48:49 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:48:44Z,direct_url=<?>,disk_format='qcow2',id=dc53f958-3e60-4cfd-97ab-fdb07c950d4d,min_disk=0,min_ram=0,name='tempest-scenario-img--1518633937',owner='3d8ad21c16ee4a04a83d6e0261f7d0c8',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:48:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:48:49 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1338382465',display_name='tempest-TestMinimumBasicScenario-server-1338382465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1338382465',id=36,image_ref='dc53f958-3e60-4cfd-97ab-fdb07c950d4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByuYkrA7eHV37yZ57qQC9gRxceovQqol45xjbuxVFK8UXskwI11NIGq1R/RAzdg/fQ9gUiyUVxBpQu3sVr+lDdwLNS3Sauh559bRAM6rR0+XyacfVp196Bbv2Ddx7KufA==',key_name='tempest-TestMinimumBasicScenario-802870250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-r6dhst4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dc53f958-3e60-4cfd-97ab-fdb07c950d4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:48:47Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=2e865190-80dc-4acf-9fd1-7f32c7f4ed48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'pci_devices' on Instance uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:48:50 user nova-compute[72724]:   <uuid>2e865190-80dc-4acf-9fd1-7f32c7f4ed48</uuid>
Aug 17 16:48:50 user nova-compute[72724]:   <name>instance-00000024</name>
Aug 17 16:48:50 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:48:50 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:48:50 user nova-compute[72724]:   <metadata>
Aug 17 16:48:50 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:48:50 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:48:50 user nova-compute[72724]:       <nova:name>tempest-TestMinimumBasicScenario-server-1338382465</nova:name>
Aug 17 16:48:50 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:48:49</nova:creationTime>
Aug 17 16:48:50 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:48:50 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:48:50 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:48:50 user nova-compute[72724]:       <nova:owner>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:user uuid="cfbf2f6beaf44499a30c0a989459ffc8">tempest-TestMinimumBasicScenario-1956650041-project-member</nova:user>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:project uuid="3d8ad21c16ee4a04a83d6e0261f7d0c8">tempest-TestMinimumBasicScenario-1956650041</nova:project>
Aug 17 16:48:50 user nova-compute[72724]:       </nova:owner>
Aug 17 16:48:50 user nova-compute[72724]:       <nova:root type="image" uuid="dc53f958-3e60-4cfd-97ab-fdb07c950d4d"/>
Aug 17 16:48:50 user nova-compute[72724]:       <nova:ports>
Aug 17 16:48:50 user nova-compute[72724]:         <nova:port uuid="6575fdbd-d53c-4942-a3c3-b5d7ebc97583">
Aug 17 16:48:50 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 17 16:48:50 user nova-compute[72724]:         </nova:port>
Aug 17 16:48:50 user nova-compute[72724]:       </nova:ports>
Aug 17 16:48:50 user nova-compute[72724]:     </nova:instance>
Aug 17 16:48:50 user nova-compute[72724]:   </metadata>
Aug 17 16:48:50 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:48:50 user nova-compute[72724]:     <system>
Aug 17 16:48:50 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:48:50 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:48:50 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:48:50 user nova-compute[72724]:       <entry name="serial">2e865190-80dc-4acf-9fd1-7f32c7f4ed48</entry>
Aug 17 16:48:50 user nova-compute[72724]:       <entry name="uuid">2e865190-80dc-4acf-9fd1-7f32c7f4ed48</entry>
Aug 17 16:48:50 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:48:50 user nova-compute[72724]:     </system>
Aug 17 16:48:50 user nova-compute[72724]:   </sysinfo>
Aug 17 16:48:50 user nova-compute[72724]:   <os>
Aug 17 16:48:50 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:48:50 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:48:50 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:48:50 user nova-compute[72724]:   </os>
Aug 17 16:48:50 user nova-compute[72724]:   <features>
Aug 17 16:48:50 user nova-compute[72724]:     <acpi/>
Aug 17 16:48:50 user nova-compute[72724]:     <apic/>
Aug 17 16:48:50 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:48:50 user nova-compute[72724]:   </features>
Aug 17 16:48:50 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:48:50 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:48:50 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:48:50 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:48:50 user nova-compute[72724]:   </clock>
Aug 17 16:48:50 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:48:50 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:48:50 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:48:50 user nova-compute[72724]:   </cpu>
Aug 17 16:48:50 user nova-compute[72724]:   <devices>
Aug 17 16:48:50 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:48:50 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:48:50 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk"/>
Aug 17 16:48:50 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:48:50 user nova-compute[72724]:     </disk>
Aug 17 16:48:50 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:48:50 user nova-compute[72724]:       <mac address="fa:16:3e:3a:6a:f3"/>
Aug 17 16:48:50 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:48:50 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:48:50 user nova-compute[72724]:       <target dev="tap6575fdbd-d5"/>
Aug 17 16:48:50 user nova-compute[72724]:     </interface>
Aug 17 16:48:50 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:48:50 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/console.log" append="off"/>
Aug 17 16:48:50 user nova-compute[72724]:     </serial>
Aug 17 16:48:50 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:48:50 user nova-compute[72724]:     <video>
Aug 17 16:48:50 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:48:50 user nova-compute[72724]:     </video>
Aug 17 16:48:50 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:48:50 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:48:50 user nova-compute[72724]:     </rng>
Aug 17 16:48:50 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:48:50 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:48:50 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:48:50 user nova-compute[72724]:     </memballoon>
Aug 17 16:48:50 user nova-compute[72724]:   </devices>
Aug 17 16:48:50 user nova-compute[72724]: </domain>
Aug 17 16:48:50 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1338382465',display_name='tempest-TestMinimumBasicScenario-server-1338382465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1338382465',id=36,image_ref='dc53f958-3e60-4cfd-97ab-fdb07c950d4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByuYkrA7eHV37yZ57qQC9gRxceovQqol45xjbuxVFK8UXskwI11NIGq1R/RAzdg/fQ9gUiyUVxBpQu3sVr+lDdwLNS3Sauh559bRAM6rR0+XyacfVp196Bbv2Ddx7KufA==',key_name='tempest-TestMinimumBasicScenario-802870250',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-r6dhst4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dc53f958-3e60-4cfd-97ab-fdb07c950d4d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:48:47Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=2e865190-80dc-4acf-9fd1-7f32c7f4ed48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG os_vif [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6575fdbd-d5, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6575fdbd-d5, col_values=(('external_ids', {'iface-id': '6575fdbd-d53c-4942-a3c3-b5d7ebc97583', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:6a:f3', 'vm-uuid': '2e865190-80dc-4acf-9fd1-7f32c7f4ed48'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:50 user nova-compute[72724]: INFO os_vif [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5')
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No VIF found with MAC fa:16:3e:3a:6a:f3, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-5302d72c-3884-4b16-9c8f-f982374ffea8 req-4ae39e12-461b-4bb7-97dc-f633dd09d66f service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5302d72c-3884-4b16-9c8f-f982374ffea8 req-4ae39e12-461b-4bb7-97dc-f633dd09d66f service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5302d72c-3884-4b16-9c8f-f982374ffea8 req-4ae39e12-461b-4bb7-97dc-f633dd09d66f service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5302d72c-3884-4b16-9c8f-f982374ffea8 req-4ae39e12-461b-4bb7-97dc-f633dd09d66f service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-5302d72c-3884-4b16-9c8f-f982374ffea8 req-4ae39e12-461b-4bb7-97dc-f633dd09d66f service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:48:51 user nova-compute[72724]: WARNING nova.compute.manager [req-5302d72c-3884-4b16-9c8f-f982374ffea8 req-4ae39e12-461b-4bb7-97dc-f633dd09d66f service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state building and task_state spawning.
Aug 17 16:48:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:48:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:48:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:48:52 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updating instance_info_cache with network_info: [{"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e0589f44-f104-4dd8-adca-f097d48d1fe5" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290933.5234554, 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] VM Resumed (Lifecycle Event)
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance spawned successfully.
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290933.5283997, 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] VM Started (Lifecycle Event)
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-9452525b-10d1-4569-bce5-d929a4210e67 req-f86edb87-a0ba-435c-b08e-a906c617e3b4 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9452525b-10d1-4569-bce5-d929a4210e67 req-f86edb87-a0ba-435c-b08e-a906c617e3b4 service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9452525b-10d1-4569-bce5-d929a4210e67 req-f86edb87-a0ba-435c-b08e-a906c617e3b4 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9452525b-10d1-4569-bce5-d929a4210e67 req-f86edb87-a0ba-435c-b08e-a906c617e3b4 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-9452525b-10d1-4569-bce5-d929a4210e67 req-f86edb87-a0ba-435c-b08e-a906c617e3b4 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:48:53 user nova-compute[72724]: WARNING nova.compute.manager [req-9452525b-10d1-4569-bce5-d929a4210e67 req-f86edb87-a0ba-435c-b08e-a906c617e3b4 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state building and task_state spawning.
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Took 6.56 seconds to spawn the instance on the hypervisor.
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:48:53 user nova-compute[72724]: INFO nova.compute.manager [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Took 7.16 seconds to build instance.
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8f475e06-5e1c-44ec-bff8-5a5387c2fc49 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.260s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:48:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:48:56 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:48:56 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.429141998291016GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e0589f44-f104-4dd8-adca-f097d48d1fe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance fe3ef284-6596-4864-8a04-2327e83b929f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 328d31f6-66b3-4bba-9091-522bf850ebe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.318s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:48:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:48:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:48:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:49:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'flavor' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:02 user nova-compute[72724]: INFO nova.compute.manager [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Attaching volume ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 to /dev/vdb
Aug 17 16:49:03 user nova-compute[72724]: DEBUG os_brick.utils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b83d55-3614-4766-9221-c4d1db7448e8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d873085c-93c5-433c-a49d-0a45e8293403]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4326ba9d-6a12-4828-8a17-916090c5168b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb261210-0597-47db-9534-60ba6f83979d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:49:03 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:49:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501f9a3-5727-450e-b21b-746cd6528fc9]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG os_brick.utils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:49:03 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating existing volume attachment record: 27123aea-a772-4713-8ca5-00b843d20a57 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-changed-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Refreshing instance network info cache due to event network-changed-f9863a84-76b0-4818-a1e2-6accee0ca226. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] Acquiring lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] Acquired lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Refreshing network info cache for port f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "fe3ef284-6596-4864-8a04-2327e83b929f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:04 user nova-compute[72724]: INFO nova.compute.manager [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Terminating instance
Aug 17 16:49:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Instance destroyed successfully.
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'resources' on Instance uuid fe3ef284-6596-4864-8a04-2327e83b929f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:47:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-790249313',display_name='tempest-AttachVolumeNegativeTest-server-790249313',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-790249313',id=34,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQmhdlSQcRngHaz3pCshs/Vik7DNYdsors7ovrYl3klSIaCpvDb8WJ8KdIbaHy2WbosRFxHJFN1jbvgxf4wo6ionkEw9bVI4W+G/TvDXd/L+I7+4wtIt9K4/cBvTP5RHg==',key_name='tempest-keypair-2123003901',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:47:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-jtyeb59w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:47:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=fe3ef284-6596-4864-8a04-2327e83b929f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG os_vif [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9863a84-76, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:49:05 user nova-compute[72724]: INFO os_vif [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:99:89,bridge_name='br-int',has_traffic_filtering=True,id=f9863a84-76b0-4818-a1e2-6accee0ca226,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9863a84-76')
Aug 17 16:49:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Deleting instance files /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f_del
Aug 17 16:49:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Deletion of /opt/stack/data/nova/instances/fe3ef284-6596-4864-8a04-2327e83b929f_del complete
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.network.neutron [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Updated VIF entry in instance network info cache for port f9863a84-76b0-4818-a1e2-6accee0ca226. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.network.neutron [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Updating instance_info_cache with network_info: [{"id": "f9863a84-76b0-4818-a1e2-6accee0ca226", "address": "fa:16:3e:89:99:89", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.12", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9863a84-76", "ovs_interfaceid": "f9863a84-76b0-4818-a1e2-6accee0ca226", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:49:05 user nova-compute[72724]: INFO nova.compute.manager [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Took 0.74 seconds to destroy the instance on the hypervisor.
Aug 17 16:49:05 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8ca798b7-e32d-4356-acc6-0b447d3c46a4 req-d231e63d-8f11-4a05-989a-9f35c14a0e60 service nova] Releasing lock "refresh_cache-fe3ef284-6596-4864-8a04-2327e83b929f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-5ccc1027-28a3-49ab-9ec9-1b7b95b96718 req-16cecfdb-5837-4491-a42b-30ced8e9b26d service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-vif-unplugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5ccc1027-28a3-49ab-9ec9-1b7b95b96718 req-16cecfdb-5837-4491-a42b-30ced8e9b26d service nova] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5ccc1027-28a3-49ab-9ec9-1b7b95b96718 req-16cecfdb-5837-4491-a42b-30ced8e9b26d service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5ccc1027-28a3-49ab-9ec9-1b7b95b96718 req-16cecfdb-5837-4491-a42b-30ced8e9b26d service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-5ccc1027-28a3-49ab-9ec9-1b7b95b96718 req-16cecfdb-5837-4491-a42b-30ced8e9b26d service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] No waiting events found dispatching network-vif-unplugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:49:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-5ccc1027-28a3-49ab-9ec9-1b7b95b96718 req-16cecfdb-5837-4491-a42b-30ced8e9b26d service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-vif-unplugged-f9863a84-76b0-4818-a1e2-6accee0ca226 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:49:06 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:49:06 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Took 1.15 seconds to deallocate network for instance.
Aug 17 16:49:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:06 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:49:06 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:49:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:06 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Deleted allocations for instance fe3ef284-6596-4864-8a04-2327e83b929f
Aug 17 16:49:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689f1d54-74ad-4a88-b3f3-29c6c06a3948 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "fe3ef284-6596-4864-8a04-2327e83b929f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.334s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] Acquiring lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] Lock "fe3ef284-6596-4864-8a04-2327e83b929f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] No waiting events found dispatching network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:49:07 user nova-compute[72724]: WARNING nova.compute.manager [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received unexpected event network-vif-plugged-f9863a84-76b0-4818-a1e2-6accee0ca226 for instance with vm_state deleted and task_state None.
Aug 17 16:49:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-e6ddb121-c846-4b6a-a60b-ca53d9f0598a req-56f9ff4e-5c66-4c9a-9604-82d34a75ff7a service nova] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Received event network-vif-deleted-f9863a84-76b0-4818-a1e2-6accee0ca226 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:49:14 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:49:14 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:49:14 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec01db92-3af2-472a-8258-82b71a350f85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:49:14 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[879cda3f-be0f-4541-a8c8-696f0bd444e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59] added
Aug 17 16:49:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6807008-8270-4d89-a0f9-b24bf2511ddf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[089b3d80-3b69-4faa-943f-39e87109de87]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcsieKNS {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcsieKNS" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7267d7-7b3a-4379-8cc6-023a507b9eb3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcsieKNS'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6038dd4f-932b-47f4-901f-cd6b3ff792e5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e02e78-455a-4684-8c81-c8f502444070]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[452153c9-d002-44dd-9f0d-eb9bbda44188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]
Aug 17 16:49:14 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.
Aug 17 16:49:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de1662c-d6c8-4416-aaa0-15005423daf6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d54f83-2fa3-4734-a188-663a2165b67c]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:14 user nova-compute[72724]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:14 user nova-compute[72724]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4cec25-f5c8-4702-9679-7725ddec25d8]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:49:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== connect_volume: return (1292ms) {'type': 'block', 'scsi_wwn': '26135643936333234', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135643936333234', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'flavor' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:49:15 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:49:15 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 16:49:15 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:49:15 user nova-compute[72724]:   <serial>ea4bcc0e-f2e3-444d-9531-c6e3231b4c59</serial>
Aug 17 16:49:15 user nova-compute[72724]: </disk>
Aug 17 16:49:15 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:49:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No VIF found with MAC fa:16:3e:94:7d:10, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:49:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02e0a42e-8203-4376-90a9-883aeb9fc1c8 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.279s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Stashing vm_state: active {{(pid=72724) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'pci_requests' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:49:18 user nova-compute[72724]: INFO nova.compute.claims [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Claim successful on node user
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'resources' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'pci_devices' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:18 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating resource usage from migration c0563c22-f4da-401f-8802-ba0bdf4df5be
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.396s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:18 user nova-compute[72724]: INFO nova.compute.manager [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Migrating
Aug 17 16:49:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:49:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Starting migrate_disk_and_power_off {{(pid=72724) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-f29c49a5-14a8-4da8-a244-ec5acb8ff8a3 req-9b5321fe-5214-4d49-80a4-0997a0a33e3b service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f29c49a5-14a8-4da8-a244-ec5acb8ff8a3 req-9b5321fe-5214-4d49-80a4-0997a0a33e3b service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f29c49a5-14a8-4da8-a244-ec5acb8ff8a3 req-9b5321fe-5214-4d49-80a4-0997a0a33e3b service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f29c49a5-14a8-4da8-a244-ec5acb8ff8a3 req-9b5321fe-5214-4d49-80a4-0997a0a33e3b service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-f29c49a5-14a8-4da8-a244-ec5acb8ff8a3 req-9b5321fe-5214-4d49-80a4-0997a0a33e3b service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:49:19 user nova-compute[72724]: WARNING nova.compute.manager [req-f29c49a5-14a8-4da8-a244-ec5acb8ff8a3 req-9b5321fe-5214-4d49-80a4-0997a0a33e3b service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state active and task_state resize_migrating.
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 328d31f6-66b3-4bba-9091-522bf850ebe9 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:19 user nova-compute[72724]: INFO nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (resize_migrating). Skip.
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290945.1082466, fe3ef284-6596-4864-8a04-2327e83b929f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:49:20 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] VM Stopped (Lifecycle Event)
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-79ba1db1-5146-4bbb-acd4-81d0fbc481e1 None None] [instance: fe3ef284-6596-4864-8a04-2327e83b929f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance destroyed successfully.
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:49:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2297e04-bf, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:49:20 user nova-compute[72724]: INFO os_vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf')
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:49:20 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4437b5f3-b27e-48fe-99e0-6fbd3b78f1dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6850c064-1440-4aa3-9fa7-241fd390b568]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:20 user nova-compute[72724]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:20 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:20 user nova-compute[72724]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:20 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c84108b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b8c826-4b5c-4abb-a7c9-4c97fe190fe7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391a3f3-ccd6-45e6-928d-9ac5bdfff7c7]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0492e57a-3e1a-40eb-9845-9f84d97774ee]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ffe6bb9-5c0d-494b-a1d6-e6a84f923583]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.072s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f063a81e-f0d0-4208-81f9-7a735d33fac6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71abb5-1463-4aa4-9b58-8e30a398be15]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]
Aug 17 16:49:20 user nova-compute[72724]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.
Aug 17 16:49:20 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc2c31e-033c-4c9e-9613-a8fac4ef9d5f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== disconnect_volume: return (349ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f_resize/disk /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "cp -r /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f_resize/disk /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk" returned: 0 in 0.352s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f_resize/disk.info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk.info {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "cp -r /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f_resize/disk.info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk.info" returned: 0 in 0.034s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-0031965b-c796-4460-a703-454d59006aab req-cd554422-7995-42d8-a9aa-24cf40af7fc1 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0031965b-c796-4460-a703-454d59006aab req-cd554422-7995-42d8-a9aa-24cf40af7fc1 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0031965b-c796-4460-a703-454d59006aab req-cd554422-7995-42d8-a9aa-24cf40af7fc1 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0031965b-c796-4460-a703-454d59006aab req-cd554422-7995-42d8-a9aa-24cf40af7fc1 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-0031965b-c796-4460-a703-454d59006aab req-cd554422-7995-42d8-a9aa-24cf40af7fc1 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:49:21 user nova-compute[72724]: WARNING nova.compute.manager [req-0031965b-c796-4460-a703-454d59006aab req-cd554422-7995-42d8-a9aa-24cf40af7fc1 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state active and task_state resize_migrating.
Aug 17 16:49:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Port d2297e04-bfc4-4316-8e25-86aa3fa0d480 binding to destination host user is already ACTIVE {{(pid=72724) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 16:49:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:49:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:49:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG nova.network.neutron [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG os_brick.utils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7e1038-9423-448f-846b-1f0a5c2730af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc0034-fd37-4519-8d1a-52b76e207ed1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcd23d7-f8cd-45a9-950c-908a55049ce2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a897eeb4-802f-4792-a978-d23cdd163de4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:49:23 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:49:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[430f9e0a-53ca-4634-b524-9c9e2e7de1d0]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:49:23 user nova-compute[72724]: DEBUG os_brick.utils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:49:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Starting finish_migration {{(pid=72724) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance directory exists: not creating {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 17 16:49:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Creating image(s)
Aug 17 16:49:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'trusted_certs' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk. size=21474836480 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk 21474836480 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk 21474836480" returned: 0 in 0.065s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Ensure instance console log exists: /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start _get_guest_xml network_info=[{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '02005c24-e054-4e0b-8146-b7e8de071c9e', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ecfe929f-699c-458f-85ef-e55a6503f73f', 'attached_at': '2023-08-17T16:49:33.000000', 'detached_at': '', 'volume_id': 'ea4bcc0e-f2e3-444d-9531-c6e3231b4c59', 'serial': 'ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:49:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:49:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:41Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'vcpu_model' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:49:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:49:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:49:34 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3afc9aa-6c3b-4f83-9caa-40041a41a5ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:49:34 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c3518f-520d-4fc5-8e8c-38d931dfc7e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59] added
Aug 17 16:49:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7095c21-d54a-471a-a771-2c585b42ef5c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f21e27-b733-4f32-9873-950d54d085ed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcsieKNS {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcsieKNS" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0b7668-096a-4948-bf2b-4f3f8a56ba1e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcsieKNS'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[564c7560-a0f5-4769-9493-d9b7b409832d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[018d828f-76a5-4e53-b017-581fc57c925b]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba8d48-e3da-41a7-be38-b66ca534b231]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]
Aug 17 16:49:34 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.
Aug 17 16:49:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1e926b-a23a-4153-844d-4a0be43f169f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38d370b-1539-4646-a45d-72a3cf824fd4]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:34 user nova-compute[72724]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:34 user nova-compute[72724]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4305dd60-dfb6-4756-b138-7cf5e32900f1]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692290960.3156483, ecfe929f-699c-458f-85ef-e55a6503f73f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:49:35 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Stopped (Lifecycle Event)
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7a41783d-8bcb-458d-b3e1-12880334f594 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-7a41783d-8bcb-458d-b3e1-12880334f594 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:49:35 user nova-compute[72724]: INFO nova.compute.manager [None req-7a41783d-8bcb-458d-b3e1-12880334f594 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 16:49:35 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== connect_volume: return (1281ms) {'type': 'block', 'scsi_wwn': '26135643936333234', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135643936333234', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:49:35 user nova-compute[72724]:   <uuid>ecfe929f-699c-458f-85ef-e55a6503f73f</uuid>
Aug 17 16:49:35 user nova-compute[72724]:   <name>instance-00000021</name>
Aug 17 16:49:35 user nova-compute[72724]:   <memory>2097152</memory>
Aug 17 16:49:35 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:49:35 user nova-compute[72724]:   <metadata>
Aug 17 16:49:35 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:49:35 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:49:35 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherB-server-461911821</nova:name>
Aug 17 16:49:35 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:49:34</nova:creationTime>
Aug 17 16:49:35 user nova-compute[72724]:       <nova:flavor name="m1.small">
Aug 17 16:49:35 user nova-compute[72724]:         <nova:memory>2048</nova:memory>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:disk>20</nova:disk>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:49:35 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:49:35 user nova-compute[72724]:       <nova:owner>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:user uuid="26ec3b8cc43c4de7af3b832b45ae4354">tempest-ServerActionsTestOtherB-586663785-project-member</nova:user>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:project uuid="5e792bbdb961424893202703ef86bb37">tempest-ServerActionsTestOtherB-586663785</nova:project>
Aug 17 16:49:35 user nova-compute[72724]:       </nova:owner>
Aug 17 16:49:35 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:49:35 user nova-compute[72724]:       <nova:ports>
Aug 17 16:49:35 user nova-compute[72724]:         <nova:port uuid="d2297e04-bfc4-4316-8e25-86aa3fa0d480">
Aug 17 16:49:35 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 16:49:35 user nova-compute[72724]:         </nova:port>
Aug 17 16:49:35 user nova-compute[72724]:       </nova:ports>
Aug 17 16:49:35 user nova-compute[72724]:     </nova:instance>
Aug 17 16:49:35 user nova-compute[72724]:   </metadata>
Aug 17 16:49:35 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:49:35 user nova-compute[72724]:     <system>
Aug 17 16:49:35 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:49:35 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:49:35 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:49:35 user nova-compute[72724]:       <entry name="serial">ecfe929f-699c-458f-85ef-e55a6503f73f</entry>
Aug 17 16:49:35 user nova-compute[72724]:       <entry name="uuid">ecfe929f-699c-458f-85ef-e55a6503f73f</entry>
Aug 17 16:49:35 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:49:35 user nova-compute[72724]:     </system>
Aug 17 16:49:35 user nova-compute[72724]:   </sysinfo>
Aug 17 16:49:35 user nova-compute[72724]:   <os>
Aug 17 16:49:35 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:49:35 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:49:35 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:49:35 user nova-compute[72724]:   </os>
Aug 17 16:49:35 user nova-compute[72724]:   <features>
Aug 17 16:49:35 user nova-compute[72724]:     <acpi/>
Aug 17 16:49:35 user nova-compute[72724]:     <apic/>
Aug 17 16:49:35 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:49:35 user nova-compute[72724]:   </features>
Aug 17 16:49:35 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:49:35 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:49:35 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:49:35 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:49:35 user nova-compute[72724]:   </clock>
Aug 17 16:49:35 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:49:35 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:49:35 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:49:35 user nova-compute[72724]:   </cpu>
Aug 17 16:49:35 user nova-compute[72724]:   <devices>
Aug 17 16:49:35 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:49:35 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:49:35 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk"/>
Aug 17 16:49:35 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:49:35 user nova-compute[72724]:     </disk>
Aug 17 16:49:35 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:49:35 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:49:35 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 16:49:35 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:49:35 user nova-compute[72724]:       <serial>ea4bcc0e-f2e3-444d-9531-c6e3231b4c59</serial>
Aug 17 16:49:35 user nova-compute[72724]:     </disk>
Aug 17 16:49:35 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:49:35 user nova-compute[72724]:       <mac address="fa:16:3e:94:7d:10"/>
Aug 17 16:49:35 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:49:35 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:49:35 user nova-compute[72724]:       <target dev="tapd2297e04-bf"/>
Aug 17 16:49:35 user nova-compute[72724]:     </interface>
Aug 17 16:49:35 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:49:35 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/console.log" append="off"/>
Aug 17 16:49:35 user nova-compute[72724]:     </serial>
Aug 17 16:49:35 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:49:35 user nova-compute[72724]:     <video>
Aug 17 16:49:35 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:49:35 user nova-compute[72724]:     </video>
Aug 17 16:49:35 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:49:35 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:49:35 user nova-compute[72724]:     </rng>
Aug 17 16:49:35 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:49:35 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:49:35 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:49:35 user nova-compute[72724]:     </memballoon>
Aug 17 16:49:35 user nova-compute[72724]:   </devices>
Aug 17 16:49:35 user nova-compute[72724]: </domain>
Aug 17 16:49:35 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:45:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:49:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1825578683-network", "vif_mac": "fa:16:3e:94:7d:10"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG os_vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2297e04-bf, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2297e04-bf, col_values=(('external_ids', {'iface-id': 'd2297e04-bfc4-4316-8e25-86aa3fa0d480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:7d:10', 'vm-uuid': 'ecfe929f-699c-458f-85ef-e55a6503f73f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:35 user nova-compute[72724]: INFO os_vif [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf')
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:49:35 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] No VIF found with MAC fa:16:3e:94:7d:10, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:49:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-86dd46bf-6e46-4249-a2c3-6e6488f1c7e8 req-72e9945e-8155-4a1a-a9cc-e14c80bf9f89 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86dd46bf-6e46-4249-a2c3-6e6488f1c7e8 req-72e9945e-8155-4a1a-a9cc-e14c80bf9f89 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86dd46bf-6e46-4249-a2c3-6e6488f1c7e8 req-72e9945e-8155-4a1a-a9cc-e14c80bf9f89 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-86dd46bf-6e46-4249-a2c3-6e6488f1c7e8 req-72e9945e-8155-4a1a-a9cc-e14c80bf9f89 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-86dd46bf-6e46-4249-a2c3-6e6488f1c7e8 req-72e9945e-8155-4a1a-a9cc-e14c80bf9f89 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:49:37 user nova-compute[72724]: WARNING nova.compute.manager [req-86dd46bf-6e46-4249-a2c3-6e6488f1c7e8 req-72e9945e-8155-4a1a-a9cc-e14c80bf9f89 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state active and task_state resize_finish.
Aug 17 16:49:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290978.9426877, ecfe929f-699c-458f-85ef-e55a6503f73f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:49:38 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Resumed (Lifecycle Event)
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:49:38 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance running successfully.
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Failed to set time: agent not configured {{(pid=72724) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-125db9f3-4d0b-4576-9f33-7ddc805948ec tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] finish_migration finished successfully. {{(pid=72724) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:49:38 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 16:49:38 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692290978.9472404, ecfe929f-699c-458f-85ef-e55a6503f73f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:49:38 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Started (Lifecycle Event)
Aug 17 16:49:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:49:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:49:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 17 16:49:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-a2f98a09-964f-4bc9-8bda-40f3c57216a4 req-bdf25ceb-7a35-43da-bc9e-7bcb4a154075 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:49:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a2f98a09-964f-4bc9-8bda-40f3c57216a4 req-bdf25ceb-7a35-43da-bc9e-7bcb4a154075 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a2f98a09-964f-4bc9-8bda-40f3c57216a4 req-bdf25ceb-7a35-43da-bc9e-7bcb4a154075 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a2f98a09-964f-4bc9-8bda-40f3c57216a4 req-bdf25ceb-7a35-43da-bc9e-7bcb4a154075 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-a2f98a09-964f-4bc9-8bda-40f3c57216a4 req-bdf25ceb-7a35-43da-bc9e-7bcb4a154075 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:49:39 user nova-compute[72724]: WARNING nova.compute.manager [req-a2f98a09-964f-4bc9-8bda-40f3c57216a4 req-bdf25ceb-7a35-43da-bc9e-7bcb4a154075 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state active and task_state resize_finish.
Aug 17 16:49:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:49:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:49:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:49:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:49:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:49:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:49:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:49:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:55 user nova-compute[72724]: INFO nova.compute.manager [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Detaching volume 14701a84-12d4-49ad-90df-16a9d91b1fa0
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:55 user nova-compute[72724]: INFO nova.virt.block_device [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Attempting to driver detach volume 14701a84-12d4-49ad-90df-16a9d91b1fa0 from mountpoint /dev/vdb
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Attempting to detach device vdb from instance e0589f44-f104-4dd8-adca-f097d48d1fe5 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:49:55 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:49:55 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:49:55 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:49:55 user nova-compute[72724]:   <serial>14701a84-12d4-49ad-90df-16a9d91b1fa0</serial>
Aug 17 16:49:55 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:49:55 user nova-compute[72724]: </disk>
Aug 17 16:49:55 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:49:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully detached device vdb from instance e0589f44-f104-4dd8-adca-f097d48d1fe5 from the persistent domain config.
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e0589f44-f104-4dd8-adca-f097d48d1fe5 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:49:55 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:49:55 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:49:55 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:49:55 user nova-compute[72724]:   <serial>14701a84-12d4-49ad-90df-16a9d91b1fa0</serial>
Aug 17 16:49:55 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:49:55 user nova-compute[72724]: </disk>
Aug 17 16:49:55 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692290996.413944, e0589f44-f104-4dd8-adca-f097d48d1fe5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:49:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully detached device vdb from instance e0589f44-f104-4dd8-adca-f097d48d1fe5 from the live domain config.
Aug 17 16:49:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yXGKrodB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:49:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3cdcec-668f-44dc-99bc-3f73d6418b71]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba77f403-e9ab-4b22-a756-28f038fced8f]: (4, ('tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:56 user nova-compute[72724]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 (non-flash)
Aug 17 16:49:56 user nova-compute[72724]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:49:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e8047d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae7604f-7c53-49f2-b148-e3ce15e0c89a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d3195-6429-4c25-9197-0f3b6e35dedb]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebd32db-18c4-4323-94a5-19bce34b0979]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21ede2b-4d66-4cb0-af4b-edbdad9c55f3]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c8d812-f95b-4184-992e-c9c39d42a178]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de279b8-515e-4c94-9633-161243753a11]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260]
Aug 17 16:49:56 user nova-compute[72724]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0, portal: 172.16.0.220,3260] successful.
Aug 17 16:49:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14701a84-12d4-49ad-90df-16a9d91b1fa0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fd4dfc-6415-47ca-9238-0c0e93f4cf2a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== disconnect_volume: return (281ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:49:57 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:49:57 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8287MB free_disk=25.371097564697266GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dff1216e-3df8-438b-b807-e82e069b73ca tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.955s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Applying migration context for instance ecfe929f-699c-458f-85ef-e55a6503f73f as it has an incoming, in-progress migration c0563c22-f4da-401f-8802-ba0bdf4df5be. Migration status is finished {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 16:49:57 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating resource usage from migration c0563c22-f4da-401f-8802-ba0bdf4df5be
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e0589f44-f104-4dd8-adca-f097d48d1fe5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 328d31f6-66b3-4bba-9091-522bf850ebe9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Migration c0563c22-f4da-401f-8802-ba0bdf4df5be is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=24GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:49:57 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:49:58 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:49:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:50:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:50:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:50:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:50:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:28 user nova-compute[72724]: INFO nova.compute.manager [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Terminating instance
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-a0b7670e-2e27-4004-8ead-e691724c5812 req-94a8432a-07b1-457f-8c54-dd04029504d6 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-vif-unplugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a0b7670e-2e27-4004-8ead-e691724c5812 req-94a8432a-07b1-457f-8c54-dd04029504d6 service nova] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a0b7670e-2e27-4004-8ead-e691724c5812 req-94a8432a-07b1-457f-8c54-dd04029504d6 service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a0b7670e-2e27-4004-8ead-e691724c5812 req-94a8432a-07b1-457f-8c54-dd04029504d6 service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-a0b7670e-2e27-4004-8ead-e691724c5812 req-94a8432a-07b1-457f-8c54-dd04029504d6 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] No waiting events found dispatching network-vif-unplugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-a0b7670e-2e27-4004-8ead-e691724c5812 req-94a8432a-07b1-457f-8c54-dd04029504d6 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-vif-unplugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Instance destroyed successfully.
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lazy-loading 'resources' on Instance uuid 328d31f6-66b3-4bba-9091-522bf850ebe9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:48:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-530149012',display_name='tempest-VolumesActionsTest-instance-530149012',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-530149012',id=35,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:48:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db5be94c68ab4e7082f8fee463f3eae9',ramdisk_id='',reservation_id='r-cnlu7c86',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1286366818',owner_user_name='tempest-VolumesActionsTest-1286366818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:48:43Z,user_data=None,user_id='1a854ae5c0a943f0a402c4abbbbd5840',uuid=328d31f6-66b3-4bba-9091-522bf850ebe9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converting VIF {"id": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "address": "fa:16:3e:1f:60:3e", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae76a78b-ae", "ovs_interfaceid": "ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG os_vif [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae76a78b-ae, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:50:28 user nova-compute[72724]: INFO os_vif [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:60:3e,bridge_name='br-int',has_traffic_filtering=True,id=ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae76a78b-ae')
Aug 17 16:50:28 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Deleting instance files /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9_del
Aug 17 16:50:28 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Deletion of /opt/stack/data/nova/instances/328d31f6-66b3-4bba-9091-522bf850ebe9_del complete
Aug 17 16:50:28 user nova-compute[72724]: INFO nova.compute.manager [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Took 0.70 seconds to destroy the instance on the hypervisor.
Aug 17 16:50:28 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:50:28 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:50:29 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:50:29 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Took 0.54 seconds to deallocate network for instance.
Aug 17 16:50:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:29 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:50:29 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:50:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:29 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Deleted allocations for instance 328d31f6-66b3-4bba-9091-522bf850ebe9
Aug 17 16:50:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2e85fe5-a3ce-4b26-9711-14477fc650a1 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.637s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] Acquiring lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] Lock "328d31f6-66b3-4bba-9091-522bf850ebe9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] No waiting events found dispatching network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:30 user nova-compute[72724]: WARNING nova.compute.manager [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received unexpected event network-vif-plugged-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 for instance with vm_state deleted and task_state None.
Aug 17 16:50:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-f8490b88-0be9-4158-bc92-d7f46d30ecd3 req-ff97767a-715a-401b-95eb-a827b84fa240 service nova] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Received event network-vif-deleted-ae76a78b-ae3d-4fdb-90a3-42f4bd3fb299 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:50:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'flavor' on Instance uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:50:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:42 user nova-compute[72724]: INFO nova.compute.manager [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Attaching volume 9268a128-08de-4972-89d3-fb67ba52e017 to /dev/vdb
Aug 17 16:50:42 user nova-compute[72724]: DEBUG os_brick.utils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4dc46c-da65-4f29-8f0d-ca13920926fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6463aaf9-891a-4780-b951-93d99cde6833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8223865-86ac-47fa-ae59-d3ee907421a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aecc10-a53f-4817-8049-c689dbb64f68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:50:42 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:50:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[73574e12-1933-408f-af9e-4ebeda0907c6]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG os_brick.utils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:50:42 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating existing volume attachment record: aceed70a-11ad-41cc-8c3c-8019e706aa96 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:50:43 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291028.6542277, 328d31f6-66b3-4bba-9091-522bf850ebe9 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:50:43 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] VM Stopped (Lifecycle Event)
Aug 17 16:50:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-999efb1f-4a7f-41f8-9856-fa2e2f7f6fb1 None None] [instance: 328d31f6-66b3-4bba-9091-522bf850ebe9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:50:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:46 user nova-compute[72724]: INFO nova.compute.manager [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Terminating instance
Aug 17 16:50:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-277ad29c-f8f0-426a-b388-bea1170c0b08 req-418728cf-6f37-40c4-aa21-4b525738dde5 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-unplugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-277ad29c-f8f0-426a-b388-bea1170c0b08 req-418728cf-6f37-40c4-aa21-4b525738dde5 service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-277ad29c-f8f0-426a-b388-bea1170c0b08 req-418728cf-6f37-40c4-aa21-4b525738dde5 service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-277ad29c-f8f0-426a-b388-bea1170c0b08 req-418728cf-6f37-40c4-aa21-4b525738dde5 service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-277ad29c-f8f0-426a-b388-bea1170c0b08 req-418728cf-6f37-40c4-aa21-4b525738dde5 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-unplugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-277ad29c-f8f0-426a-b388-bea1170c0b08 req-418728cf-6f37-40c4-aa21-4b525738dde5 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-unplugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Instance destroyed successfully.
Aug 17 16:50:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'resources' on Instance uuid e0589f44-f104-4dd8-adca-f097d48d1fe5 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1162594149',display_name='tempest-AttachVolumeNegativeTest-server-1162594149',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1162594149',id=32,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCl7Z8nqAExgPcmueYfzYdEod0GXHAIf+d0p4dw2IWJ5Tk2Uvwwg8dTgtYFmeBSm0XkxPqNrH2mhMCZbzInWyvt2N8Dyrs9LipTxErxwIFcsuTDL+68+YkfM3LC+Rr5trg==',key_name='tempest-keypair-1907534712',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:45:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-vawawshj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:45:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=e0589f44-f104-4dd8-adca-f097d48d1fe5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "address": "fa:16:3e:41:9a:a0", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6cc95c9-50", "ovs_interfaceid": "b6cc95c9-50ba-4713-82dc-a89a9e446515", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG os_vif [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6cc95c9-50, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:50:47 user nova-compute[72724]: INFO os_vif [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:9a:a0,bridge_name='br-int',has_traffic_filtering=True,id=b6cc95c9-50ba-4713-82dc-a89a9e446515,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6cc95c9-50')
Aug 17 16:50:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Deleting instance files /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5_del
Aug 17 16:50:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Deletion of /opt/stack/data/nova/instances/e0589f44-f104-4dd8-adca-f097d48d1fe5_del complete
Aug 17 16:50:47 user nova-compute[72724]: INFO nova.compute.manager [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 16:50:47 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:48 user nova-compute[72724]: WARNING nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received unexpected event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with vm_state active and task_state deleting.
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:48 user nova-compute[72724]: WARNING nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received unexpected event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with vm_state active and task_state deleting.
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:48 user nova-compute[72724]: WARNING nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received unexpected event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with vm_state active and task_state deleting.
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-unplugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-unplugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd12aba6-452e-4562-9d2a-6897efab73d2 req-ed1a4cd3-8c00-45e5-aac0-783ddc402c5b service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-unplugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:50:48 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:50:48 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Took 1.88 seconds to deallocate network for instance.
Aug 17 16:50:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:49 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:50:49 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:50:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:49 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Deleted allocations for instance e0589f44-f104-4dd8-adca-f097d48d1fe5
Aug 17 16:50:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-476dd948-eb7f-40ab-8115-77c381d1fed1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.133s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] Acquiring lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] Lock "e0589f44-f104-4dd8-adca-f097d48d1fe5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] No waiting events found dispatching network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:50:50 user nova-compute[72724]: WARNING nova.compute.manager [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received unexpected event network-vif-plugged-b6cc95c9-50ba-4713-82dc-a89a9e446515 for instance with vm_state deleted and task_state None.
Aug 17 16:50:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-de263578-82d2-42a2-a17e-e24b24241998 req-a1a5a856-71e0-429e-8751-58bba6cd5987 service nova] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Received event network-vif-deleted-b6cc95c9-50ba-4713-82dc-a89a9e446515 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:52 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsdzRpVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:50:53 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:50:53 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:50:53 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbc6049-82a0-4206-a30b-34bab90e6273]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:50:53 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eff8385-3ba8-451a-9519-621453e3df7c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017] added
Aug 17 16:50:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050f07a-4338-42f2-8b1d-b42a106a356a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[186b7f81-4490-4c41-be41-556d0f43b3db]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsdzRpVN {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QsdzRpVN" returned: 0 in 0.031s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1a1071-a228-49f2-bff1-b3fecb539389]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QsdzRpVN'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1db029-f2ee-4e55-a502-0e1a456e4786]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9959023-db1b-4ed2-8b39-4071f412bcc1]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:50:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:50:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76370ea4-a0ae-4242-bf01-345b3d2f8f75]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260]
Aug 17 16:50:53 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260] successful.
Aug 17 16:50:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a0c667-53fb-4f1c-b1d7-550632c4eb31]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9ef921-9ec8-4bd7-ac80-ec42f579d6bf]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:50:53 user nova-compute[72724]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:50:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:50:53 user nova-compute[72724]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:50:53 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[29cf4871-5a27-4a8b-afba-65cedc3e5f55]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsdzRpVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:50:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23635663762666538', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635663762666538', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'flavor' on Instance uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:50:54 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:50:54 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:50:54 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:50:54 user nova-compute[72724]:   <serial>9268a128-08de-4972-89d3-fb67ba52e017</serial>
Aug 17 16:50:54 user nova-compute[72724]: </disk>
Aug 17 16:50:54 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:50:54 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] No VIF found with MAC fa:16:3e:3a:6a:f3, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f6ce1683-1491-472a-9401-cba6aacdc339 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.163s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:50:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing instance network info cache due to event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG nova.network.neutron [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:57 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG nova.network.neutron [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updated VIF entry in instance network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG nova.network.neutron [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-32be025f-6cf6-4f2b-bc56-1a3bb5bf4e45 req-bff7d7ef-7f16-4606-84bc-cb624a4e320d service nova] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:50:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:50:59 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:50:59 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.417156219482422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Applying migration context for instance ecfe929f-699c-458f-85ef-e55a6503f73f as it has an incoming, in-progress migration c0563c22-f4da-401f-8802-ba0bdf4df5be. Migration status is finished {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 17 16:50:59 user nova-compute[72724]: INFO nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating resource usage from migration c0563c22-f4da-401f-8802-ba0bdf4df5be
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Migration c0563c22-f4da-401f-8802-ba0bdf4df5be is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=22GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.274s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing instance network info cache due to event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:50:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:00 user nova-compute[72724]: INFO nova.compute.manager [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Rebooting instance
Aug 17 16:51:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updated VIF entry in instance network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG nova.network.neutron [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-63e3a0ff-43eb-4412-bd24-9ee53d348a22 req-b92c86be-c6b1-4599-84d8-8c6da5b20692 service nova] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:01 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291046.969242, e0589f44-f104-4dd8-adca-f097d48d1fe5 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:01 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] VM Stopped (Lifecycle Event)
Aug 17 16:51:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-027983f0-86a1-4ac7-b5c8-d774bbea9e5b None None] [instance: e0589f44-f104-4dd8-adca-f097d48d1fe5] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-a62f1102-d840-4881-b889-8410f3e61f7f req-8637dc6a-4cc6-4d9c-adee-5fe80f944dc2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-unplugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a62f1102-d840-4881-b889-8410f3e61f7f req-8637dc6a-4cc6-4d9c-adee-5fe80f944dc2 service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a62f1102-d840-4881-b889-8410f3e61f7f req-8637dc6a-4cc6-4d9c-adee-5fe80f944dc2 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a62f1102-d840-4881-b889-8410f3e61f7f req-8637dc6a-4cc6-4d9c-adee-5fe80f944dc2 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-a62f1102-d840-4881-b889-8410f3e61f7f req-8637dc6a-4cc6-4d9c-adee-5fe80f944dc2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-unplugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:03 user nova-compute[72724]: WARNING nova.compute.manager [req-a62f1102-d840-4881-b889-8410f3e61f7f req-8637dc6a-4cc6-4d9c-adee-5fe80f944dc2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-unplugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state active and task_state reboot_started.
Aug 17 16:51:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance shutdown successfully.
Aug 17 16:51:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-9b01afe6-f157-41eb-85c2-76cb7b71eaf6 req-e268a64f-996a-4733-98d8-60800910c50e service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9b01afe6-f157-41eb-85c2-76cb7b71eaf6 req-e268a64f-996a-4733-98d8-60800910c50e service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9b01afe6-f157-41eb-85c2-76cb7b71eaf6 req-e268a64f-996a-4733-98d8-60800910c50e service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9b01afe6-f157-41eb-85c2-76cb7b71eaf6 req-e268a64f-996a-4733-98d8-60800910c50e service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-9b01afe6-f157-41eb-85c2-76cb7b71eaf6 req-e268a64f-996a-4733-98d8-60800910c50e service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:05 user nova-compute[72724]: WARNING nova.compute.manager [req-9b01afe6-f157-41eb-85c2-76cb7b71eaf6 req-e268a64f-996a-4733-98d8-60800910c50e service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state active and task_state reboot_started.
Aug 17 16:51:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:07 user nova-compute[72724]: WARNING nova.compute.manager [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state active and task_state reboot_started.
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:07 user nova-compute[72724]: WARNING nova.compute.manager [req-983f5771-9628-4064-b95d-2a98d9cf4201 req-0c377fe6-78d6-478b-8813-64db9c54a724 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state active and task_state reboot_started.
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Removed pending event for 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 due to event {{(pid=72724) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291067.7243023, 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:07 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] VM Resumed (Lifecycle Event)
Aug 17 16:51:07 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance running successfully.
Aug 17 16:51:07 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance soft rebooted successfully.
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:07 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291067.7255032, 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:07 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] VM Started (Lifecycle Event)
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cfbe7f10-2f06-4d4c-9cab-7b30958151dd tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.464s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Port d2297e04-bfc4-4316-8e25-86aa3fa0d480 binding to destination host user is already ACTIVE {{(pid=72724) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Creating tmpfile /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/tmpx54dgg20 to verify with other compute node that the instance is on the same shared storage. {{(pid=72724) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:09 user nova-compute[72724]: WARNING nova.compute.manager [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:09 user nova-compute[72724]: WARNING nova.compute.manager [req-1a8d8f91-cad4-4581-af7c-ce7253b3158d req-2ac437ce-7132-4923-9f27-8fc02d89fa66 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance destroyed successfully.
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'resources' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:49:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2297e04-bf, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:51:09 user nova-compute[72724]: INFO os_vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf')
Aug 17 16:51:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:51:09 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[096394e0-6253-4385-a5a9-b69104656dae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefab4bb-b000-4817-8763-2da69c1de705]: (4, ('tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:51:09 user nova-compute[72724]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:51:09 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:51:09 user nova-compute[72724]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:51:09 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c834fc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d79c87-cb22-4580-8d0d-21753732136b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc08e1d-0f3d-4f3f-9dd3-d3781115482e]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[39361f55-0d94-4151-818a-1027713203e0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:51:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[819c7875-731e-4368-b87f-b3ccc682eb03]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e203b66d-cb54-454a-a59a-b7bf58b112b3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1dc71b-7f35-41d9-8724-b922c071cb29]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]
Aug 17 16:51:10 user nova-compute[72724]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.
Aug 17 16:51:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c7d5b6-086c-4614-8c79-5c6ca44ff35f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== disconnect_volume: return (322ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'migration_context' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.233s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:11 user nova-compute[72724]: INFO nova.compute.manager [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Swapping old allocation on dict_keys(['754b4011-d0b6-4fa1-8aed-3fbcbaa664d1']) held by migration c0563c22-f4da-401f-8802-ba0bdf4df5be for instance
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Overwriting current allocation {'allocations': {'754b4011-d0b6-4fa1-8aed-3fbcbaa664d1': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 45}}, 'project_id': '5e792bbdb961424893202703ef86bb37', 'user_id': '26ec3b8cc43c4de7af3b832b45ae4354', 'consumer_generation': 1} on consumer ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:11 user nova-compute[72724]: WARNING nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:11 user nova-compute[72724]: WARNING nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:11 user nova-compute[72724]: WARNING nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:11 user nova-compute[72724]: WARNING nova.compute.manager [req-840d5b9b-d08b-4c17-ae28-3c47f7406a54 req-4818fc4b-96a8-4a85-bd1a-bea82aefe6ce service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG os_brick.utils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[33574e13-2541-4769-b4a6-d211e5406252]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cfe115-6cc7-47ed-9770-4f074aa09c6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb386e42-4b83-47fd-aa96-6ae26438b116]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bf1049-bce6-43ff-80d8-6b778c41c672]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:51:12 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:51:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bebb6cb-3f17-460e-9961-1e96d0e83741]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:51:12 user nova-compute[72724]: DEBUG os_brick.utils [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:51:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:19 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:51:19 user nova-compute[72724]: INFO nova.compute.claims [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Claim successful on node user
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:51:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.policy [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1a854ae5c0a943f0a402c4abbbbd5840', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'db5be94c68ab4e7082f8fee463f3eae9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:51:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Creating image(s)
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "/opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "/opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "/opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk 1073741824" returned: 0 in 0.049s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Successfully created port: 7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Cannot resize image /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lazy-loading 'migration_context' on Instance uuid 58cdabac-8046-4f4c-a801-45f6dd51d841 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Ensure instance console log exists: /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Successfully updated port: 7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "refresh_cache-58cdabac-8046-4f4c-a801-45f6dd51d841" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquired lock "refresh_cache-58cdabac-8046-4f4c-a801-45f6dd51d841" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-changed-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Refreshing instance network info cache due to event network-changed-7f9c3dfb-a508-4837-a7d6-9430d02dabfa. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] Acquiring lock "refresh_cache-58cdabac-8046-4f4c-a801-45f6dd51d841" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Updating instance_info_cache with network_info: [{"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Releasing lock "refresh_cache-58cdabac-8046-4f4c-a801-45f6dd51d841" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Instance network_info: |[{"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] Acquired lock "refresh_cache-58cdabac-8046-4f4c-a801-45f6dd51d841" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Refreshing network info cache for port 7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Start _get_guest_xml network_info=[{"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:51:22 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:51:22 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1315077094',display_name='tempest-VolumesActionsTest-instance-1315077094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1315077094',id=37,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db5be94c68ab4e7082f8fee463f3eae9',ramdisk_id='',reservation_id='r-rnusamg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1286366818',owner_user_name='tempest-VolumesActionsTest-1286366818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:51:20Z,user_data=None,user_id='1a854ae5c0a943f0a402c4abbbbd5840',uuid=58cdabac-8046-4f4c-a801-45f6dd51d841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converting VIF {"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lazy-loading 'pci_devices' on Instance uuid 58cdabac-8046-4f4c-a801-45f6dd51d841 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:51:22 user nova-compute[72724]:   <uuid>58cdabac-8046-4f4c-a801-45f6dd51d841</uuid>
Aug 17 16:51:22 user nova-compute[72724]:   <name>instance-00000025</name>
Aug 17 16:51:22 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:51:22 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:51:22 user nova-compute[72724]:   <metadata>
Aug 17 16:51:22 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:51:22 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:51:22 user nova-compute[72724]:       <nova:name>tempest-VolumesActionsTest-instance-1315077094</nova:name>
Aug 17 16:51:22 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:51:22</nova:creationTime>
Aug 17 16:51:22 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:51:22 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:51:22 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:51:22 user nova-compute[72724]:       <nova:owner>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:user uuid="1a854ae5c0a943f0a402c4abbbbd5840">tempest-VolumesActionsTest-1286366818-project-member</nova:user>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:project uuid="db5be94c68ab4e7082f8fee463f3eae9">tempest-VolumesActionsTest-1286366818</nova:project>
Aug 17 16:51:22 user nova-compute[72724]:       </nova:owner>
Aug 17 16:51:22 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:51:22 user nova-compute[72724]:       <nova:ports>
Aug 17 16:51:22 user nova-compute[72724]:         <nova:port uuid="7f9c3dfb-a508-4837-a7d6-9430d02dabfa">
Aug 17 16:51:22 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 16:51:22 user nova-compute[72724]:         </nova:port>
Aug 17 16:51:22 user nova-compute[72724]:       </nova:ports>
Aug 17 16:51:22 user nova-compute[72724]:     </nova:instance>
Aug 17 16:51:22 user nova-compute[72724]:   </metadata>
Aug 17 16:51:22 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:51:22 user nova-compute[72724]:     <system>
Aug 17 16:51:22 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:51:22 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:51:22 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:51:22 user nova-compute[72724]:       <entry name="serial">58cdabac-8046-4f4c-a801-45f6dd51d841</entry>
Aug 17 16:51:22 user nova-compute[72724]:       <entry name="uuid">58cdabac-8046-4f4c-a801-45f6dd51d841</entry>
Aug 17 16:51:22 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:51:22 user nova-compute[72724]:     </system>
Aug 17 16:51:22 user nova-compute[72724]:   </sysinfo>
Aug 17 16:51:22 user nova-compute[72724]:   <os>
Aug 17 16:51:22 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:51:22 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:51:22 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:51:22 user nova-compute[72724]:   </os>
Aug 17 16:51:22 user nova-compute[72724]:   <features>
Aug 17 16:51:22 user nova-compute[72724]:     <acpi/>
Aug 17 16:51:22 user nova-compute[72724]:     <apic/>
Aug 17 16:51:22 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:51:22 user nova-compute[72724]:   </features>
Aug 17 16:51:22 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:51:22 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:51:22 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:51:22 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:51:22 user nova-compute[72724]:   </clock>
Aug 17 16:51:22 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:51:22 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:51:22 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:51:22 user nova-compute[72724]:   </cpu>
Aug 17 16:51:22 user nova-compute[72724]:   <devices>
Aug 17 16:51:22 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:51:22 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:51:22 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk"/>
Aug 17 16:51:22 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:51:22 user nova-compute[72724]:     </disk>
Aug 17 16:51:22 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:51:22 user nova-compute[72724]:       <mac address="fa:16:3e:fa:1e:10"/>
Aug 17 16:51:22 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:51:22 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:51:22 user nova-compute[72724]:       <target dev="tap7f9c3dfb-a5"/>
Aug 17 16:51:22 user nova-compute[72724]:     </interface>
Aug 17 16:51:22 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:51:22 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/console.log" append="off"/>
Aug 17 16:51:22 user nova-compute[72724]:     </serial>
Aug 17 16:51:22 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:51:22 user nova-compute[72724]:     <video>
Aug 17 16:51:22 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:51:22 user nova-compute[72724]:     </video>
Aug 17 16:51:22 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:51:22 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:51:22 user nova-compute[72724]:     </rng>
Aug 17 16:51:22 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:51:22 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:51:22 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:51:22 user nova-compute[72724]:     </memballoon>
Aug 17 16:51:22 user nova-compute[72724]:   </devices>
Aug 17 16:51:22 user nova-compute[72724]: </domain>
Aug 17 16:51:22 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1315077094',display_name='tempest-VolumesActionsTest-instance-1315077094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1315077094',id=37,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='db5be94c68ab4e7082f8fee463f3eae9',ramdisk_id='',reservation_id='r-rnusamg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1286366818',owner_user_name='tempest-VolumesActionsTest-1286366818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:51:20Z,user_data=None,user_id='1a854ae5c0a943f0a402c4abbbbd5840',uuid=58cdabac-8046-4f4c-a801-45f6dd51d841,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converting VIF {"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG os_vif [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7f9c3dfb-a5, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7f9c3dfb-a5, col_values=(('external_ids', {'iface-id': '7f9c3dfb-a508-4837-a7d6-9430d02dabfa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:1e:10', 'vm-uuid': '58cdabac-8046-4f4c-a801-45f6dd51d841'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:22 user nova-compute[72724]: INFO os_vif [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5')
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] No VIF found with MAC fa:16:3e:fa:1e:10, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Updated VIF entry in instance network info cache for port 7f9c3dfb-a508-4837-a7d6-9430d02dabfa. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG nova.network.neutron [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Updating instance_info_cache with network_info: [{"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93bf1ea5-4ead-4fda-94ab-db9ec1a3acce req-3dbc703f-5ee7-46d5-8ce3-8ab9565bb5f1 service nova] Releasing lock "refresh_cache-58cdabac-8046-4f4c-a801-45f6dd51d841" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Starting finish_revert_migration {{(pid=72724) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start _get_guest_xml network_info=[{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9c8f042e-8f02-4275-8c49-09458e0d1f41', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'ecfe929f-699c-458f-85ef-e55a6503f73f', 'attached_at': '2023-08-17T16:51:23.000000', 'detached_at': '', 'volume_id': 'ea4bcc0e-f2e3-444d-9531-c6e3231b4c59', 'serial': 'ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:51:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:51:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'vcpu_model' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:51:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:51:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:51:23 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b880df28-4db0-4118-9c04-ca7493c90c44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:51:23 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[822a8f74-c707-4fe0-a97b-9fe02cfd67c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59] added
Aug 17 16:51:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae30e254-6068-4ad5-9b8c-138b6a6516bf]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d4204d-e5de-4c61-b2f1-90dfc82f4414]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcsieKNS {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LcsieKNS" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccf9498-5c98-44c0-a689-6bb3623726e2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LcsieKNS'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[223d6970-b411-4277-a65a-4e187b7f0c05]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6968eea-6098-4209-9809-3926c10f64bc]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:51:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:51:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ead7cb-46a9-45a5-b0ca-58adf895330f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]
Aug 17 16:51:23 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.
Aug 17 16:51:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[149d5b77-79de-4e07-bb19-ee5641933df4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b1e540-0bb4-4605-b2e9-4d35763f8de6]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:51:23 user nova-compute[72724]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:51:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:51:23 user nova-compute[72724]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:51:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[338c6e71-d507-42a3-bded-4ebc79910a17]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:51:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-98085c7c-0d1e-4699-b889-ebe4308f3dac req-74db29af-8821-4662-b35e-b0c7a80c0bd6 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-98085c7c-0d1e-4699-b889-ebe4308f3dac req-74db29af-8821-4662-b35e-b0c7a80c0bd6 service nova] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-98085c7c-0d1e-4699-b889-ebe4308f3dac req-74db29af-8821-4662-b35e-b0c7a80c0bd6 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-98085c7c-0d1e-4699-b889-ebe4308f3dac req-74db29af-8821-4662-b35e-b0c7a80c0bd6 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-98085c7c-0d1e-4699-b889-ebe4308f3dac req-74db29af-8821-4662-b35e-b0c7a80c0bd6 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] No waiting events found dispatching network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:24 user nova-compute[72724]: WARNING nova.compute.manager [req-98085c7c-0d1e-4699-b889-ebe4308f3dac req-74db29af-8821-4662-b35e-b0c7a80c0bd6 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received unexpected event network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa for instance with vm_state building and task_state spawning.
Aug 17 16:51:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26135643936333234', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135643936333234', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:51:24 user nova-compute[72724]:   <uuid>ecfe929f-699c-458f-85ef-e55a6503f73f</uuid>
Aug 17 16:51:24 user nova-compute[72724]:   <name>instance-00000021</name>
Aug 17 16:51:24 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:51:24 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:51:24 user nova-compute[72724]:   <metadata>
Aug 17 16:51:24 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:51:24 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:51:24 user nova-compute[72724]:       <nova:name>tempest-ServerActionsTestOtherB-server-461911821</nova:name>
Aug 17 16:51:24 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:51:23</nova:creationTime>
Aug 17 16:51:24 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:51:24 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:51:24 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:51:24 user nova-compute[72724]:       <nova:owner>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:user uuid="26ec3b8cc43c4de7af3b832b45ae4354">tempest-ServerActionsTestOtherB-586663785-project-member</nova:user>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:project uuid="5e792bbdb961424893202703ef86bb37">tempest-ServerActionsTestOtherB-586663785</nova:project>
Aug 17 16:51:24 user nova-compute[72724]:       </nova:owner>
Aug 17 16:51:24 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:51:24 user nova-compute[72724]:       <nova:ports>
Aug 17 16:51:24 user nova-compute[72724]:         <nova:port uuid="d2297e04-bfc4-4316-8e25-86aa3fa0d480">
Aug 17 16:51:24 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 17 16:51:24 user nova-compute[72724]:         </nova:port>
Aug 17 16:51:24 user nova-compute[72724]:       </nova:ports>
Aug 17 16:51:24 user nova-compute[72724]:     </nova:instance>
Aug 17 16:51:24 user nova-compute[72724]:   </metadata>
Aug 17 16:51:24 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:51:24 user nova-compute[72724]:     <system>
Aug 17 16:51:24 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:51:24 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:51:24 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:51:24 user nova-compute[72724]:       <entry name="serial">ecfe929f-699c-458f-85ef-e55a6503f73f</entry>
Aug 17 16:51:24 user nova-compute[72724]:       <entry name="uuid">ecfe929f-699c-458f-85ef-e55a6503f73f</entry>
Aug 17 16:51:24 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:51:24 user nova-compute[72724]:     </system>
Aug 17 16:51:24 user nova-compute[72724]:   </sysinfo>
Aug 17 16:51:24 user nova-compute[72724]:   <os>
Aug 17 16:51:24 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:51:24 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:51:24 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:51:24 user nova-compute[72724]:   </os>
Aug 17 16:51:24 user nova-compute[72724]:   <features>
Aug 17 16:51:24 user nova-compute[72724]:     <acpi/>
Aug 17 16:51:24 user nova-compute[72724]:     <apic/>
Aug 17 16:51:24 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:51:24 user nova-compute[72724]:   </features>
Aug 17 16:51:24 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:51:24 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:51:24 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:51:24 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:51:24 user nova-compute[72724]:   </clock>
Aug 17 16:51:24 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:51:24 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:51:24 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:51:24 user nova-compute[72724]:   </cpu>
Aug 17 16:51:24 user nova-compute[72724]:   <devices>
Aug 17 16:51:24 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:51:24 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:51:24 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk"/>
Aug 17 16:51:24 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:51:24 user nova-compute[72724]:     </disk>
Aug 17 16:51:24 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:51:24 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:51:24 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 16:51:24 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:51:24 user nova-compute[72724]:       <serial>ea4bcc0e-f2e3-444d-9531-c6e3231b4c59</serial>
Aug 17 16:51:24 user nova-compute[72724]:     </disk>
Aug 17 16:51:24 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:51:24 user nova-compute[72724]:       <mac address="fa:16:3e:94:7d:10"/>
Aug 17 16:51:24 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:51:24 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:51:24 user nova-compute[72724]:       <target dev="tapd2297e04-bf"/>
Aug 17 16:51:24 user nova-compute[72724]:     </interface>
Aug 17 16:51:24 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:51:24 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/console.log" append="off"/>
Aug 17 16:51:24 user nova-compute[72724]:     </serial>
Aug 17 16:51:24 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:51:24 user nova-compute[72724]:     <video>
Aug 17 16:51:24 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:51:24 user nova-compute[72724]:     </video>
Aug 17 16:51:24 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:51:24 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:51:24 user nova-compute[72724]:     </rng>
Aug 17 16:51:24 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:51:24 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:51:24 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:51:24 user nova-compute[72724]:     </memballoon>
Aug 17 16:51:24 user nova-compute[72724]:   </devices>
Aug 17 16:51:24 user nova-compute[72724]: </domain>
Aug 17 16:51:24 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:49:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:51:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG os_vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd2297e04-bf, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd2297e04-bf, col_values=(('external_ids', {'iface-id': 'd2297e04-bfc4-4316-8e25-86aa3fa0d480', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:7d:10', 'vm-uuid': 'ecfe929f-699c-458f-85ef-e55a6503f73f'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: INFO os_vif [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf')
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291069.782816, ecfe929f-699c-458f-85ef-e55a6503f73f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:24 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Stopped (Lifecycle Event)
Aug 17 16:51:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-52f0c3f8-5bf6-4af4-a9b4-aecc384cf8d3 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291086.1889393, 58cdabac-8046-4f4c-a801-45f6dd51d841 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] VM Resumed (Lifecycle Event)
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Instance spawned successfully.
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-d5a03b4c-96b8-4d30-9654-0782782abeb8 req-ce3894fa-8bac-47a5-b30d-98c441039815 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5a03b4c-96b8-4d30-9654-0782782abeb8 req-ce3894fa-8bac-47a5-b30d-98c441039815 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5a03b4c-96b8-4d30-9654-0782782abeb8 req-ce3894fa-8bac-47a5-b30d-98c441039815 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5a03b4c-96b8-4d30-9654-0782782abeb8 req-ce3894fa-8bac-47a5-b30d-98c441039815 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-d5a03b4c-96b8-4d30-9654-0782782abeb8 req-ce3894fa-8bac-47a5-b30d-98c441039815 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:26 user nova-compute[72724]: WARNING nova.compute.manager [req-d5a03b4c-96b8-4d30-9654-0782782abeb8 req-ce3894fa-8bac-47a5-b30d-98c441039815 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state resized and task_state resize_reverting.
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-ddf116ae-37b1-42f8-8f02-1069ccb09c19 req-d940be59-9663-4e19-be6a-13051ebc1606 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ddf116ae-37b1-42f8-8f02-1069ccb09c19 req-d940be59-9663-4e19-be6a-13051ebc1606 service nova] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ddf116ae-37b1-42f8-8f02-1069ccb09c19 req-d940be59-9663-4e19-be6a-13051ebc1606 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ddf116ae-37b1-42f8-8f02-1069ccb09c19 req-d940be59-9663-4e19-be6a-13051ebc1606 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-ddf116ae-37b1-42f8-8f02-1069ccb09c19 req-d940be59-9663-4e19-be6a-13051ebc1606 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] No waiting events found dispatching network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:26 user nova-compute[72724]: WARNING nova.compute.manager [req-ddf116ae-37b1-42f8-8f02-1069ccb09c19 req-d940be59-9663-4e19-be6a-13051ebc1606 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received unexpected event network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa for instance with vm_state building and task_state spawning.
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291086.190926, 58cdabac-8046-4f4c-a801-45f6dd51d841 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] VM Started (Lifecycle Event)
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Took 5.88 seconds to spawn the instance on the hypervisor.
Aug 17 16:51:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:26 user nova-compute[72724]: INFO nova.compute.manager [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Took 6.57 seconds to build instance.
Aug 17 16:51:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e3124bc6-fb8c-47a0-9877-e6e4df04de53 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.706s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291088.017942, ecfe929f-699c-458f-85ef-e55a6503f73f => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:28 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Resumed (Lifecycle Event)
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:51:28 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance running successfully.
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] finish_revert_migration finished successfully. {{(pid=72724) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:28 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291088.0214837, ecfe929f-699c-458f-85ef-e55a6503f73f => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:28 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Started (Lifecycle Event)
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:28 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 17 16:51:28 user nova-compute[72724]: INFO nova.compute.manager [None req-2b2514bd-4caa-47a2-8411-613f22dbe664 tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance to original state: 'active'
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-7e59e3a6-3e4d-4273-9bc7-e65c4633d49d req-33e75dd9-c753-43e6-8ad5-c029af2e8b24 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7e59e3a6-3e4d-4273-9bc7-e65c4633d49d req-33e75dd9-c753-43e6-8ad5-c029af2e8b24 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7e59e3a6-3e4d-4273-9bc7-e65c4633d49d req-33e75dd9-c753-43e6-8ad5-c029af2e8b24 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7e59e3a6-3e4d-4273-9bc7-e65c4633d49d req-33e75dd9-c753-43e6-8ad5-c029af2e8b24 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-7e59e3a6-3e4d-4273-9bc7-e65c4633d49d req-33e75dd9-c753-43e6-8ad5-c029af2e8b24 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:28 user nova-compute[72724]: WARNING nova.compute.manager [req-7e59e3a6-3e4d-4273-9bc7-e65c4633d49d req-33e75dd9-c753-43e6-8ad5-c029af2e8b24 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state active and task_state None.
Aug 17 16:51:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:51:40 user nova-compute[72724]: INFO nova.compute.claims [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Claim successful on node user
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:51:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:51:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Creating image(s)
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG nova.policy [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05a8d77a3b04cc783d6ef9fdea15526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d8a38870654abe8b40aeb3ee406293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk 1073741824" returned: 0 in 0.056s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Successfully created port: bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Cannot resize image /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'migration_context' on Instance uuid ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Ensure instance console log exists: /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Successfully updated port: bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquired lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-changed-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Refreshing instance network info cache due to event network-changed-bad0d981-8983-4cd7-9852-d09f8956d372. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] Acquiring lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updating instance_info_cache with network_info: [{"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Releasing lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Instance network_info: |[{"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] Acquired lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Refreshing network info cache for port bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Start _get_guest_xml network_info=[{"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:51:42 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:51:42 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-908112911',display_name='tempest-AttachVolumeNegativeTest-server-908112911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-908112911',id=38,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2BaGaTy3JZNnSmjAHWPCL3S8TJLlfrbAxl2OUV5Uhlig9KBEfUdMLr9qvGKue/ALQCv1eqV/hODR5hrq8KlBXVbWcpmopdLmDVXjbrBCESqTM1EFXE0bAcNud+EZMQ+g==',key_name='tempest-keypair-631178954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-zhp1u0ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:51:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=ecb96343-9e44-442e-a14f-41a2f82e7a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'pci_devices' on Instance uuid ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:51:42 user nova-compute[72724]:   <uuid>ecb96343-9e44-442e-a14f-41a2f82e7a50</uuid>
Aug 17 16:51:42 user nova-compute[72724]:   <name>instance-00000026</name>
Aug 17 16:51:42 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:51:42 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:51:42 user nova-compute[72724]:   <metadata>
Aug 17 16:51:42 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:51:42 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:51:42 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeNegativeTest-server-908112911</nova:name>
Aug 17 16:51:42 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:51:42</nova:creationTime>
Aug 17 16:51:42 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:51:42 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:51:42 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:51:42 user nova-compute[72724]:       <nova:owner>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:user uuid="d05a8d77a3b04cc783d6ef9fdea15526">tempest-AttachVolumeNegativeTest-1491105836-project-member</nova:user>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:project uuid="d5d8a38870654abe8b40aeb3ee406293">tempest-AttachVolumeNegativeTest-1491105836</nova:project>
Aug 17 16:51:42 user nova-compute[72724]:       </nova:owner>
Aug 17 16:51:42 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:51:42 user nova-compute[72724]:       <nova:ports>
Aug 17 16:51:42 user nova-compute[72724]:         <nova:port uuid="bad0d981-8983-4cd7-9852-d09f8956d372">
Aug 17 16:51:42 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 16:51:42 user nova-compute[72724]:         </nova:port>
Aug 17 16:51:42 user nova-compute[72724]:       </nova:ports>
Aug 17 16:51:42 user nova-compute[72724]:     </nova:instance>
Aug 17 16:51:42 user nova-compute[72724]:   </metadata>
Aug 17 16:51:42 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:51:42 user nova-compute[72724]:     <system>
Aug 17 16:51:42 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:51:42 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:51:42 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:51:42 user nova-compute[72724]:       <entry name="serial">ecb96343-9e44-442e-a14f-41a2f82e7a50</entry>
Aug 17 16:51:42 user nova-compute[72724]:       <entry name="uuid">ecb96343-9e44-442e-a14f-41a2f82e7a50</entry>
Aug 17 16:51:42 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:51:42 user nova-compute[72724]:     </system>
Aug 17 16:51:42 user nova-compute[72724]:   </sysinfo>
Aug 17 16:51:42 user nova-compute[72724]:   <os>
Aug 17 16:51:42 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:51:42 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:51:42 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:51:42 user nova-compute[72724]:   </os>
Aug 17 16:51:42 user nova-compute[72724]:   <features>
Aug 17 16:51:42 user nova-compute[72724]:     <acpi/>
Aug 17 16:51:42 user nova-compute[72724]:     <apic/>
Aug 17 16:51:42 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:51:42 user nova-compute[72724]:   </features>
Aug 17 16:51:42 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:51:42 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:51:42 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:51:42 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:51:42 user nova-compute[72724]:   </clock>
Aug 17 16:51:42 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:51:42 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:51:42 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:51:42 user nova-compute[72724]:   </cpu>
Aug 17 16:51:42 user nova-compute[72724]:   <devices>
Aug 17 16:51:42 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:51:42 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:51:42 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk"/>
Aug 17 16:51:42 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:51:42 user nova-compute[72724]:     </disk>
Aug 17 16:51:42 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:51:42 user nova-compute[72724]:       <mac address="fa:16:3e:8d:60:2c"/>
Aug 17 16:51:42 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:51:42 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:51:42 user nova-compute[72724]:       <target dev="tapbad0d981-89"/>
Aug 17 16:51:42 user nova-compute[72724]:     </interface>
Aug 17 16:51:42 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:51:42 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/console.log" append="off"/>
Aug 17 16:51:42 user nova-compute[72724]:     </serial>
Aug 17 16:51:42 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:51:42 user nova-compute[72724]:     <video>
Aug 17 16:51:42 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:51:42 user nova-compute[72724]:     </video>
Aug 17 16:51:42 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:51:42 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:51:42 user nova-compute[72724]:     </rng>
Aug 17 16:51:42 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:51:42 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:51:42 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:51:42 user nova-compute[72724]:     </memballoon>
Aug 17 16:51:42 user nova-compute[72724]:   </devices>
Aug 17 16:51:42 user nova-compute[72724]: </domain>
Aug 17 16:51:42 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-908112911',display_name='tempest-AttachVolumeNegativeTest-server-908112911',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-908112911',id=38,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2BaGaTy3JZNnSmjAHWPCL3S8TJLlfrbAxl2OUV5Uhlig9KBEfUdMLr9qvGKue/ALQCv1eqV/hODR5hrq8KlBXVbWcpmopdLmDVXjbrBCESqTM1EFXE0bAcNud+EZMQ+g==',key_name='tempest-keypair-631178954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-zhp1u0ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:51:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=ecb96343-9e44-442e-a14f-41a2f82e7a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG os_vif [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbad0d981-89, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbad0d981-89, col_values=(('external_ids', {'iface-id': 'bad0d981-8983-4cd7-9852-d09f8956d372', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:60:2c', 'vm-uuid': 'ecb96343-9e44-442e-a14f-41a2f82e7a50'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:42 user nova-compute[72724]: INFO os_vif [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89')
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:8d:60:2c, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updated VIF entry in instance network info cache for port bad0d981-8983-4cd7-9852-d09f8956d372. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG nova.network.neutron [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updating instance_info_cache with network_info: [{"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ebc575b0-1fbd-485a-a59e-b50c26ee4275 req-f5912b04-c03f-4979-8869-af303772d3fe service nova] Releasing lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-50c32fcd-be88-4d3c-ba7d-89c80717b2ec req-6a4073f5-9eec-43ed-a500-c185ce6227bc service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50c32fcd-be88-4d3c-ba7d-89c80717b2ec req-6a4073f5-9eec-43ed-a500-c185ce6227bc service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50c32fcd-be88-4d3c-ba7d-89c80717b2ec req-6a4073f5-9eec-43ed-a500-c185ce6227bc service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-50c32fcd-be88-4d3c-ba7d-89c80717b2ec req-6a4073f5-9eec-43ed-a500-c185ce6227bc service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG nova.compute.manager [req-50c32fcd-be88-4d3c-ba7d-89c80717b2ec req-6a4073f5-9eec-43ed-a500-c185ce6227bc service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:44 user nova-compute[72724]: WARNING nova.compute.manager [req-50c32fcd-be88-4d3c-ba7d-89c80717b2ec req-6a4073f5-9eec-43ed-a500-c185ce6227bc service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received unexpected event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with vm_state building and task_state spawning.
Aug 17 16:51:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291106.0808897, ecb96343-9e44-442e-a14f-41a2f82e7a50 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] VM Resumed (Lifecycle Event)
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Instance spawned successfully.
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291106.082151, ecb96343-9e44-442e-a14f-41a2f82e7a50 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] VM Started (Lifecycle Event)
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Took 5.62 seconds to spawn the instance on the hypervisor.
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-4a2c1c0d-c943-4e28-9642-23cbee204224 req-2e7276e3-4329-4b58-b516-8dac2eedea1b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4a2c1c0d-c943-4e28-9642-23cbee204224 req-2e7276e3-4329-4b58-b516-8dac2eedea1b service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4a2c1c0d-c943-4e28-9642-23cbee204224 req-2e7276e3-4329-4b58-b516-8dac2eedea1b service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4a2c1c0d-c943-4e28-9642-23cbee204224 req-2e7276e3-4329-4b58-b516-8dac2eedea1b service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-4a2c1c0d-c943-4e28-9642-23cbee204224 req-2e7276e3-4329-4b58-b516-8dac2eedea1b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:51:46 user nova-compute[72724]: WARNING nova.compute.manager [req-4a2c1c0d-c943-4e28-9642-23cbee204224 req-2e7276e3-4329-4b58-b516-8dac2eedea1b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received unexpected event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with vm_state building and task_state spawning.
Aug 17 16:51:46 user nova-compute[72724]: INFO nova.compute.manager [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Took 6.27 seconds to build instance.
Aug 17 16:51:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2a4089f5-cead-4d1a-bfb1-7e22a38a6e37 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.366s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:51:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:51:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:51:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:51:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:51:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:51:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:51:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:51:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:51:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:01 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:52:01 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8124MB free_disk=25.38620376586914GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 58cdabac-8046-4f4c-a801-45f6dd51d841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecb96343-9e44-442e-a14f-41a2f82e7a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:52:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:52:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:52:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.296s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:52:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:52:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:52:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:51 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing instance network info cache due to event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:52:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updated VIF entry in instance network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.108", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-351138aa-feb2-4343-ab09-598560aafec8 req-9956c240-fa10-4b37-9d4e-31017828c3a2 service nova] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing instance network info cache due to event network-changed-6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] Acquiring lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] Acquired lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Refreshing network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:52:53 user nova-compute[72724]: INFO nova.compute.manager [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Detaching volume 9268a128-08de-4972-89d3-fb67ba52e017
Aug 17 16:52:53 user nova-compute[72724]: INFO nova.virt.block_device [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Attempting to driver detach volume 9268a128-08de-4972-89d3-fb67ba52e017 from mountpoint /dev/vdb
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Attempting to detach device vdb from instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:52:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:52:53 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:52:53 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:52:53 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:52:53 user nova-compute[72724]:   <serial>9268a128-08de-4972-89d3-fb67ba52e017</serial>
Aug 17 16:52:53 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:52:53 user nova-compute[72724]: </disk>
Aug 17 16:52:53 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:52:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully detached device vdb from instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 from the persistent domain config.
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:52:54 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:52:54 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:52:54 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:52:54 user nova-compute[72724]:   <serial>9268a128-08de-4972-89d3-fb67ba52e017</serial>
Aug 17 16:52:54 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:52:54 user nova-compute[72724]: </disk>
Aug 17 16:52:54 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291174.4391656, 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:52:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully detached device vdb from instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 from the live domain config.
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QsdzRpVN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:52:54 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[39428fa2-2041-45b5-9032-10ed50202aaa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aa5d36-1f59-4fb2-a31a-cc770dcacdea]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:52:54 user nova-compute[72724]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:52:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 (non-flash)
Aug 17 16:52:54 user nova-compute[72724]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:52:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c83fdbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9bcfb65-5f16-4cfb-b33e-58d5fbf9b0c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59d357c-5db7-431b-bd4c-130f53697d9f]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade1a9b1-d166-49a4-b393-7c40ccc7fa54]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8e7af7-eb98-432f-a975-9c00339f5ed6]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e52256-1e72-4066-8160-73609752e876]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updated VIF entry in instance network info cache for port 6575fdbd-d53c-4942-a3c3-b5d7ebc97583. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [{"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2726669-0e83-4b3f-b0c2-104814a47328]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260]
Aug 17 16:52:54 user nova-compute[72724]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017, portal: 172.16.0.220,3260] successful.
Aug 17 16:52:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2441cb1f-7a69-4c74-bfde-b926e0327e59 req-791ce681-09b1-4041-b99e-76fef3045b52 service nova] Releasing lock "refresh_cache-2e865190-80dc-4acf-9fd1-7f32c7f4ed48" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9268a128-08de-4972-89d3-fb67ba52e017 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3865bdcc-8504-4fcc-9271-596ba64a9f21]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] <== disconnect_volume: return (255ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:52:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:52:55 user nova-compute[72724]: DEBUG nova.objects.instance [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'flavor' on Instance uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:52:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-cdd8ab18-eaf7-490c-9c1d-5ff47fc8bc59 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.699s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:52:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:52:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:52:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [{"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:52:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-ecfe929f-699c-458f-85ef-e55a6503f73f" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:52:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:52:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:52:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:52:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:01 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:53:01 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.383495330810547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 58cdabac-8046-4f4c-a801-45f6dd51d841 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecb96343-9e44-442e-a14f-41a2f82e7a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:53:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:53:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:10 user nova-compute[72724]: INFO nova.compute.manager [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Terminating instance
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-05fe2823-d0f0-429e-97fe-5de666a32dc7 req-2dff5b19-1370-48bb-b7c6-02610df9de95 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-vif-unplugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-05fe2823-d0f0-429e-97fe-5de666a32dc7 req-2dff5b19-1370-48bb-b7c6-02610df9de95 service nova] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-05fe2823-d0f0-429e-97fe-5de666a32dc7 req-2dff5b19-1370-48bb-b7c6-02610df9de95 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-05fe2823-d0f0-429e-97fe-5de666a32dc7 req-2dff5b19-1370-48bb-b7c6-02610df9de95 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-05fe2823-d0f0-429e-97fe-5de666a32dc7 req-2dff5b19-1370-48bb-b7c6-02610df9de95 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] No waiting events found dispatching network-vif-unplugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-05fe2823-d0f0-429e-97fe-5de666a32dc7 req-2dff5b19-1370-48bb-b7c6-02610df9de95 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-vif-unplugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:53:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Instance destroyed successfully.
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lazy-loading 'resources' on Instance uuid 58cdabac-8046-4f4c-a801-45f6dd51d841 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1315077094',display_name='tempest-VolumesActionsTest-instance-1315077094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1315077094',id=37,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:51:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='db5be94c68ab4e7082f8fee463f3eae9',ramdisk_id='',reservation_id='r-rnusamg0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1286366818',owner_user_name='tempest-VolumesActionsTest-1286366818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:51:26Z,user_data=None,user_id='1a854ae5c0a943f0a402c4abbbbd5840',uuid=58cdabac-8046-4f4c-a801-45f6dd51d841,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converting VIF {"id": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "address": "fa:16:3e:fa:1e:10", "network": {"id": "bef1512b-5ca4-4f49-bf8d-0981e4d0a02a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-130871396-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "db5be94c68ab4e7082f8fee463f3eae9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7f9c3dfb-a5", "ovs_interfaceid": "7f9c3dfb-a508-4837-a7d6-9430d02dabfa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG os_vif [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7f9c3dfb-a5, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:53:10 user nova-compute[72724]: INFO os_vif [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1e:10,bridge_name='br-int',has_traffic_filtering=True,id=7f9c3dfb-a508-4837-a7d6-9430d02dabfa,network=Network(bef1512b-5ca4-4f49-bf8d-0981e4d0a02a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7f9c3dfb-a5')
Aug 17 16:53:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Deleting instance files /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841_del
Aug 17 16:53:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Deletion of /opt/stack/data/nova/instances/58cdabac-8046-4f4c-a801-45f6dd51d841_del complete
Aug 17 16:53:10 user nova-compute[72724]: INFO nova.compute.manager [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 17 16:53:10 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:53:10 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:53:11 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:53:11 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Took 0.56 seconds to deallocate network for instance.
Aug 17 16:53:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-04087c2f-3972-4e42-ace7-1b8cd46b3272 req-678915b8-c7ba-4348-b742-22c4b0e906b4 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-vif-deleted-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:11 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:53:11 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:53:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.164s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:11 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Deleted allocations for instance 58cdabac-8046-4f4c-a801-45f6dd51d841
Aug 17 16:53:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e81072bf-38ab-4f46-91c9-ec4dbc2e2a29 tempest-VolumesActionsTest-1286366818 tempest-VolumesActionsTest-1286366818-project-member] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.563s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-12d9273f-0094-44af-a782-4c2ddfd3c68f req-b299e234-88f9-4f9e-8b1a-fbcaf86af817 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received event network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-12d9273f-0094-44af-a782-4c2ddfd3c68f req-b299e234-88f9-4f9e-8b1a-fbcaf86af817 service nova] Acquiring lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-12d9273f-0094-44af-a782-4c2ddfd3c68f req-b299e234-88f9-4f9e-8b1a-fbcaf86af817 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-12d9273f-0094-44af-a782-4c2ddfd3c68f req-b299e234-88f9-4f9e-8b1a-fbcaf86af817 service nova] Lock "58cdabac-8046-4f4c-a801-45f6dd51d841-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-12d9273f-0094-44af-a782-4c2ddfd3c68f req-b299e234-88f9-4f9e-8b1a-fbcaf86af817 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] No waiting events found dispatching network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:53:12 user nova-compute[72724]: WARNING nova.compute.manager [req-12d9273f-0094-44af-a782-4c2ddfd3c68f req-b299e234-88f9-4f9e-8b1a-fbcaf86af817 service nova] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Received unexpected event network-vif-plugged-7f9c3dfb-a508-4837-a7d6-9430d02dabfa for instance with vm_state deleted and task_state None.
Aug 17 16:53:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:53:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:53:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:53:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:53:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:25 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291190.8865156, 58cdabac-8046-4f4c-a801-45f6dd51d841 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:53:25 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] VM Stopped (Lifecycle Event)
Aug 17 16:53:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c38a77b9-4885-46bc-bc95-555287307042 None None] [instance: 58cdabac-8046-4f4c-a801-45f6dd51d841] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:53:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-changed-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Refreshing instance network info cache due to event network-changed-bad0d981-8983-4cd7-9852-d09f8956d372. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] Acquiring lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] Acquired lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Refreshing network info cache for port bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updated VIF entry in instance network info cache for port bad0d981-8983-4cd7-9852-d09f8956d372. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updating instance_info_cache with network_info: [{"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a6687e46-8d8c-4f4e-bff2-833593e35223 req-fbf0e82c-63c8-48ce-b0c4-e47492916b0b service nova] Releasing lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:53:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:53:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:35 user nova-compute[72724]: INFO nova.compute.manager [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Attaching volume ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 to /dev/vdb
Aug 17 16:53:35 user nova-compute[72724]: DEBUG os_brick.utils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d03902-10ac-4922-9bb3-5ea1d796f51b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[768b7ad1-0097-4032-8990-179c08a6f64f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[19abb40d-4a61-4cb3-a83a-7c464035db74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f5ff2ec-3851-4d6f-8bf1-5adfdc6ae550]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:53:35 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:53:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e80a6dd-00b0-4651-bba6-623121b0d505]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG os_brick.utils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updating existing volume attachment record: d8f8c50f-b815-45b8-8a99-9ee4a4239e15 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:53:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Terminating instance
Aug 17 16:53:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-8aa46d6b-8506-4bf3-bc2f-b41d9034c95a req-0af6f9f5-987d-4685-bff3-f5be2f24ad9c service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-unplugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8aa46d6b-8506-4bf3-bc2f-b41d9034c95a req-0af6f9f5-987d-4685-bff3-f5be2f24ad9c service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8aa46d6b-8506-4bf3-bc2f-b41d9034c95a req-0af6f9f5-987d-4685-bff3-f5be2f24ad9c service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8aa46d6b-8506-4bf3-bc2f-b41d9034c95a req-0af6f9f5-987d-4685-bff3-f5be2f24ad9c service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-8aa46d6b-8506-4bf3-bc2f-b41d9034c95a req-0af6f9f5-987d-4685-bff3-f5be2f24ad9c service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-unplugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-8aa46d6b-8506-4bf3-bc2f-b41d9034c95a req-0af6f9f5-987d-4685-bff3-f5be2f24ad9c service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-unplugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:53:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Instance destroyed successfully.
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lazy-loading 'resources' on Instance uuid 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:48:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1338382465',display_name='tempest-TestMinimumBasicScenario-server-1338382465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1338382465',id=36,image_ref='dc53f958-3e60-4cfd-97ab-fdb07c950d4d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByuYkrA7eHV37yZ57qQC9gRxceovQqol45xjbuxVFK8UXskwI11NIGq1R/RAzdg/fQ9gUiyUVxBpQu3sVr+lDdwLNS3Sauh559bRAM6rR0+XyacfVp196Bbv2Ddx7KufA==',key_name='tempest-TestMinimumBasicScenario-802870250',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:48:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3d8ad21c16ee4a04a83d6e0261f7d0c8',ramdisk_id='',reservation_id='r-r6dhst4j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dc53f958-3e60-4cfd-97ab-fdb07c950d4d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1956650041',owner_user_name='tempest-TestMinimumBasicScenario-1956650041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:51:08Z,user_data=None,user_id='cfbf2f6beaf44499a30c0a989459ffc8',uuid=2e865190-80dc-4acf-9fd1-7f32c7f4ed48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converting VIF {"id": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "address": "fa:16:3e:3a:6a:f3", "network": {"id": "705cdf21-baa2-4e44-bb4f-3eaf32fed61e", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1415722624-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3d8ad21c16ee4a04a83d6e0261f7d0c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6575fdbd-d5", "ovs_interfaceid": "6575fdbd-d53c-4942-a3c3-b5d7ebc97583", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG os_vif [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6575fdbd-d5, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:53:51 user nova-compute[72724]: INFO os_vif [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:6a:f3,bridge_name='br-int',has_traffic_filtering=True,id=6575fdbd-d53c-4942-a3c3-b5d7ebc97583,network=Network(705cdf21-baa2-4e44-bb4f-3eaf32fed61e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6575fdbd-d5')
Aug 17 16:53:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Deleting instance files /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48_del
Aug 17 16:53:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Deletion of /opt/stack/data/nova/instances/2e865190-80dc-4acf-9fd1-7f32c7f4ed48_del complete
Aug 17 16:53:51 user nova-compute[72724]: INFO nova.compute.manager [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Took 0.86 seconds to destroy the instance on the hypervisor.
Aug 17 16:53:51 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:53:51 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:53:52 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Took 0.70 seconds to deallocate network for instance.
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-b83d71b5-7acd-4f6a-9da4-136cb7869e74 req-8be3dc7b-4272-4f96-9410-c9b65f200825 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-deleted-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQWfdPSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:53:52 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:53:52 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:53:52 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b760ce-3534-41f7-b8fe-ad84f10cae9b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:53:52 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbfca89-94be-4a92-bb46-6233beed1710]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532] added
Aug 17 16:53:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde8fed3-5999-49e1-a08e-f2bdb844020e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c988f57-08e3-4fec-bc74-08b72a70bb91]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQWfdPSG {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xQWfdPSG" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cccd3d-dc92-476f-a057-54160d06d125]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xQWfdPSG'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[affcc836-93a0-4e44-8703-84cd58b17771]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Deleted allocations for instance 2e865190-80dc-4acf-9fd1-7f32c7f4ed48
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c634773-3b93-4a0e-b413-18a1eeae07ac]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:53:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:53:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[746f5a2f-ce9a-4a49-8d91-e33fa437c5fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260]
Aug 17 16:53:52 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260] successful.
Aug 17 16:53:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a2555-6af9-424b-9a97-2a91a5b79f9e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-3326ac48-cad4-423a-a0f6-eefae28ba458 tempest-TestMinimumBasicScenario-1956650041 tempest-TestMinimumBasicScenario-1956650041-project-member] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.961s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[075a0ebf-aa87-42ea-9d6d-e378e69eea57]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:53:52 user nova-compute[72724]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 (non-flash)
Aug 17 16:53:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:53:52 user nova-compute[72724]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 (non-flash)
Aug 17 16:53:52 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1206bbc-bb49-490e-b58e-edbf7aae5d65]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:53:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQWfdPSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-59989df5-6e49-4951-83b3-81895ca1e21c req-c8bbd276-2c83-4802-998b-424af1e55768 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-59989df5-6e49-4951-83b3-81895ca1e21c req-c8bbd276-2c83-4802-998b-424af1e55768 service nova] Acquiring lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-59989df5-6e49-4951-83b3-81895ca1e21c req-c8bbd276-2c83-4802-998b-424af1e55768 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-59989df5-6e49-4951-83b3-81895ca1e21c req-c8bbd276-2c83-4802-998b-424af1e55768 service nova] Lock "2e865190-80dc-4acf-9fd1-7f32c7f4ed48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-59989df5-6e49-4951-83b3-81895ca1e21c req-c8bbd276-2c83-4802-998b-424af1e55768 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] No waiting events found dispatching network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:53:53 user nova-compute[72724]: WARNING nova.compute.manager [req-59989df5-6e49-4951-83b3-81895ca1e21c req-c8bbd276-2c83-4802-998b-424af1e55768 service nova] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Received unexpected event network-vif-plugged-6575fdbd-d53c-4942-a3c3-b5d7ebc97583 for instance with vm_state deleted and task_state None.
Aug 17 16:53:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23434303065623632', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434303065623632', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:53:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:53:53 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:53:53 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:53:53 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:53:53 user nova-compute[72724]:   <serial>ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532</serial>
Aug 17 16:53:53 user nova-compute[72724]: </disk>
Aug 17 16:53:53 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:53:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:53:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:53:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:8d:60:2c, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:53:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8ba3f334-350f-4e36-8054-24e1035771cc tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.164s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:55 user nova-compute[72724]: INFO nova.compute.manager [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Detaching volume ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532
Aug 17 16:53:55 user nova-compute[72724]: INFO nova.virt.block_device [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Attempting to driver detach volume ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 from mountpoint /dev/vdb
Aug 17 16:53:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Attempting to detach device vdb from instance ecb96343-9e44-442e-a14f-41a2f82e7a50 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:53:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:53:55 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:53:55 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:53:55 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:53:55 user nova-compute[72724]:   <serial>ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532</serial>
Aug 17 16:53:55 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:53:55 user nova-compute[72724]: </disk>
Aug 17 16:53:55 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:53:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully detached device vdb from instance ecb96343-9e44-442e-a14f-41a2f82e7a50 from the persistent domain config.
Aug 17 16:53:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ecb96343-9e44-442e-a14f-41a2f82e7a50 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:53:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:53:55 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:53:55 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:53:55 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:53:55 user nova-compute[72724]:   <serial>ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532</serial>
Aug 17 16:53:55 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:53:55 user nova-compute[72724]: </disk>
Aug 17 16:53:55 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291236.3271275, ecb96343-9e44-442e-a14f-41a2f82e7a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:53:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully detached device vdb from instance ecb96343-9e44-442e-a14f-41a2f82e7a50 from the live domain config.
Aug 17 16:53:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xQWfdPSG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:53:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[638baff2-10d8-4cb1-808d-b736911fb0f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c95c54-9730-4baf-8bbc-13c696a70dd5]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:53:56 user nova-compute[72724]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 (non-flash)
Aug 17 16:53:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:53:56 user nova-compute[72724]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 (non-flash)
Aug 17 16:53:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81be7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f36c60-ecf4-4590-8d62-8d15cd960340]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b841aaca-227a-4d6b-8754-5dec50f91446]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e2ca8-ae00-43fc-b838-fba217a2338f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccbc7cc-4775-4066-92e8-02c3b192fda9]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f733793f-1974-482d-ba67-11af2751f71b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef0322-3266-412f-a4dc-9abd1f0ab3ee]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260]
Aug 17 16:53:56 user nova-compute[72724]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532, portal: 172.16.0.220,3260] successful.
Aug 17 16:53:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab4e8f56-7e5a-4a5d-abb4-7e2c3600f532 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ca7545-5e43-4ce3-93c0-bfd1b5e43a5b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== disconnect_volume: return (282ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:53:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-fe2b9051-7561-4c46-b4cb-0d58ecd9e42b tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.594s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:53:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:53:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:53:58 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updating instance_info_cache with network_info: [{"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-ecb96343-9e44-442e-a14f-41a2f82e7a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:59 user nova-compute[72724]: INFO nova.compute.manager [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Terminating instance
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c73f381-627f-4429-b2ca-5cf6d0c225df req-7d926dce-67d4-4569-b381-67b1d22ca679 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c73f381-627f-4429-b2ca-5cf6d0c225df req-7d926dce-67d4-4569-b381-67b1d22ca679 service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c73f381-627f-4429-b2ca-5cf6d0c225df req-7d926dce-67d4-4569-b381-67b1d22ca679 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c73f381-627f-4429-b2ca-5cf6d0c225df req-7d926dce-67d4-4569-b381-67b1d22ca679 service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c73f381-627f-4429-b2ca-5cf6d0c225df req-7d926dce-67d4-4569-b381-67b1d22ca679 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:53:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c73f381-627f-4429-b2ca-5cf6d0c225df req-7d926dce-67d4-4569-b381-67b1d22ca679 service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-unplugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:54:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Instance destroyed successfully.
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lazy-loading 'resources' on Instance uuid ecfe929f-699c-458f-85ef-e55a6503f73f {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:45:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-461911821',display_name='tempest-ServerActionsTestOtherB-server-461911821',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-461911821',id=33,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNiTSskK34aZMaKtRUE1+LXDcP9rzWUvH+yzjS+BpT9JPEginPMig4hulVflHnYfj/amHw8UXRRLfABgUXAt8ZTJDN+bK/+F4oK3/RZGH8VTPWBR5QGPkwziSJH3Cl8hzw==',key_name='tempest-keypair-1127634158',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:51:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5e792bbdb961424893202703ef86bb37',ramdisk_id='',reservation_id='r-uv1qobc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-586663785',owner_user_name='tempest-ServerActionsTestOtherB-586663785-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26ec3b8cc43c4de7af3b832b45ae4354',uuid=ecfe929f-699c-458f-85ef-e55a6503f73f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converting VIF {"id": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "address": "fa:16:3e:94:7d:10", "network": {"id": "68717603-a9fc-444e-b539-74dad94c0fbe", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1825578683-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5e792bbdb961424893202703ef86bb37", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2297e04-bf", "ovs_interfaceid": "d2297e04-bfc4-4316-8e25-86aa3fa0d480", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_vif [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2297e04-bf, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:54:00 user nova-compute[72724]: INFO os_vif [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:94:7d:10,bridge_name='br-int',has_traffic_filtering=True,id=d2297e04-bfc4-4316-8e25-86aa3fa0d480,network=Network(68717603-a9fc-444e-b539-74dad94c0fbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2297e04-bf')
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LcsieKNS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:54:00 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bc6f72-9120-498a-adf2-6e1028a1aedb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66307e8a-f721-4020-ae20-0a52768086f9]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:54:00 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 (non-flash)
Aug 17 16:54:00 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86edbd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2802d69-807f-479b-b5f0-a544fe6864d3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce5e0f-f832-46da-8660-2ed51c69791c]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[22664d6b-a175-49be-85eb-b81ea40638ca]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5d17f3-1628-4b9f-9204-8944d018386d]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[20637e23-fc15-43df-b73b-52387630477e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d327aa68-792c-4bdf-a94a-7e764eeb41c8]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260]
Aug 17 16:54:00 user nova-compute[72724]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59, portal: 172.16.0.220,3260] successful.
Aug 17 16:54:00 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ea4bcc0e-f2e3-444d-9531-c6e3231b4c59 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9d889e-1675-4108-a407-19182ecdffc7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] <== disconnect_volume: return (262ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:54:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Deleting instance files /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f_del
Aug 17 16:54:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Deletion of /opt/stack/data/nova/instances/ecfe929f-699c-458f-85ef-e55a6503f73f_del complete
Aug 17 16:54:00 user nova-compute[72724]: INFO nova.compute.manager [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Took 1.15 seconds to destroy the instance on the hypervisor.
Aug 17 16:54:00 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:54:00 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:54:01 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Took 1.06 seconds to deallocate network for instance.
Aug 17 16:54:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-797454cb-c024-492a-bdba-71da30440e4f req-bca74241-9392-4ff5-aacd-4b1feb73171b service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-deleted-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-3d03ef20-cd66-409a-9147-1e4b7788280a req-8e95d4e1-8d81-4f6a-a046-b62760b6d04f service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3d03ef20-cd66-409a-9147-1e4b7788280a req-8e95d4e1-8d81-4f6a-a046-b62760b6d04f service nova] Acquiring lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3d03ef20-cd66-409a-9147-1e4b7788280a req-8e95d4e1-8d81-4f6a-a046-b62760b6d04f service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3d03ef20-cd66-409a-9147-1e4b7788280a req-8e95d4e1-8d81-4f6a-a046-b62760b6d04f service nova] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-3d03ef20-cd66-409a-9147-1e4b7788280a req-8e95d4e1-8d81-4f6a-a046-b62760b6d04f service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] No waiting events found dispatching network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:54:01 user nova-compute[72724]: WARNING nova.compute.manager [req-3d03ef20-cd66-409a-9147-1e4b7788280a req-8e95d4e1-8d81-4f6a-a046-b62760b6d04f service nova] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Received unexpected event network-vif-plugged-d2297e04-bfc4-4316-8e25-86aa3fa0d480 for instance with vm_state active and task_state deleting.
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:54:02 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:54:02 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8708MB free_disk=25.4658203125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:02 user nova-compute[72724]: INFO nova.compute.manager [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Took 0.86 seconds to detach 1 volumes for instance.
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecfe929f-699c-458f-85ef-e55a6503f73f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance ecb96343-9e44-442e-a14f-41a2f82e7a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.231s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.163s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:54:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.140s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:02 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Deleted allocations for instance ecfe929f-699c-458f-85ef-e55a6503f73f
Aug 17 16:54:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b223ec0a-41be-496d-8780-cd40ad487bcc tempest-ServerActionsTestOtherB-586663785 tempest-ServerActionsTestOtherB-586663785-project-member] Lock "ecfe929f-699c-458f-85ef-e55a6503f73f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.549s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:06 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291231.4857106, 2e865190-80dc-4acf-9fd1-7f32c7f4ed48 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:54:06 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] VM Stopped (Lifecycle Event)
Aug 17 16:54:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-16f1db49-d8ae-4d5c-9ec6-882dfd1ec4b7 None None] [instance: 2e865190-80dc-4acf-9fd1-7f32c7f4ed48] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:54:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:15 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291240.2845783, ecfe929f-699c-458f-85ef-e55a6503f73f => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:54:15 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] VM Stopped (Lifecycle Event)
Aug 17 16:54:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4f30f79e-885e-47cd-9baf-27138f7cf308 None None] [instance: ecfe929f-699c-458f-85ef-e55a6503f73f] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:54:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:54:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:54:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:54:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:54:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:46 user nova-compute[72724]: INFO nova.compute.manager [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Terminating instance
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-f4dc39ac-df78-4962-a1ca-b89470d466b1 req-77b8bc2f-79af-45ca-83a9-bfd3576618ac service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-unplugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f4dc39ac-df78-4962-a1ca-b89470d466b1 req-77b8bc2f-79af-45ca-83a9-bfd3576618ac service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f4dc39ac-df78-4962-a1ca-b89470d466b1 req-77b8bc2f-79af-45ca-83a9-bfd3576618ac service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f4dc39ac-df78-4962-a1ca-b89470d466b1 req-77b8bc2f-79af-45ca-83a9-bfd3576618ac service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-f4dc39ac-df78-4962-a1ca-b89470d466b1 req-77b8bc2f-79af-45ca-83a9-bfd3576618ac service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-unplugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-f4dc39ac-df78-4962-a1ca-b89470d466b1 req-77b8bc2f-79af-45ca-83a9-bfd3576618ac service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-unplugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Instance destroyed successfully.
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'resources' on Instance uuid ecb96343-9e44-442e-a14f-41a2f82e7a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:51:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-908112911',display_name='tempest-AttachVolumeNegativeTest-server-908112911',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-908112911',id=38,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE2BaGaTy3JZNnSmjAHWPCL3S8TJLlfrbAxl2OUV5Uhlig9KBEfUdMLr9qvGKue/ALQCv1eqV/hODR5hrq8KlBXVbWcpmopdLmDVXjbrBCESqTM1EFXE0bAcNud+EZMQ+g==',key_name='tempest-keypair-631178954',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:51:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-zhp1u0ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:51:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=ecb96343-9e44-442e-a14f-41a2f82e7a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "bad0d981-8983-4cd7-9852-d09f8956d372", "address": "fa:16:3e:8d:60:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad0d981-89", "ovs_interfaceid": "bad0d981-8983-4cd7-9852-d09f8956d372", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG os_vif [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbad0d981-89, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:47 user nova-compute[72724]: INFO os_vif [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:60:2c,bridge_name='br-int',has_traffic_filtering=True,id=bad0d981-8983-4cd7-9852-d09f8956d372,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad0d981-89')
Aug 17 16:54:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Deleting instance files /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50_del
Aug 17 16:54:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Deletion of /opt/stack/data/nova/instances/ecb96343-9e44-442e-a14f-41a2f82e7a50_del complete
Aug 17 16:54:47 user nova-compute[72724]: INFO nova.compute.manager [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 17 16:54:47 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:54:48 user nova-compute[72724]: WARNING nova.compute.manager [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received unexpected event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with vm_state active and task_state deleting.
Aug 17 16:54:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:54:48 user nova-compute[72724]: WARNING nova.compute.manager [req-88a0d141-a5e4-416e-b8ac-fbb4649b7a33 req-ef42e8ab-3eeb-4b68-9c2d-b3bc6f684a54 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received unexpected event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with vm_state active and task_state deleting.
Aug 17 16:54:49 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:54:49 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Took 2.48 seconds to deallocate network for instance.
Aug 17 16:54:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:49 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:54:49 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:54:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:49 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Deleted allocations for instance ecb96343-9e44-442e-a14f-41a2f82e7a50
Aug 17 16:54:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0ba3176b-3001-4346-8bdd-118787120b40 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.732s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:54:50 user nova-compute[72724]: WARNING nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received unexpected event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with vm_state deleted and task_state None.
Aug 17 16:54:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] Acquiring lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] Lock "ecb96343-9e44-442e-a14f-41a2f82e7a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:54:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] No waiting events found dispatching network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:54:50 user nova-compute[72724]: WARNING nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received unexpected event network-vif-plugged-bad0d981-8983-4cd7-9852-d09f8956d372 for instance with vm_state deleted and task_state None.
Aug 17 16:54:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-87dc8920-25a6-41e0-a047-4d1fa48cda3a req-957897b1-667c-41af-953e-700a6ecafb90 service nova] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Received event network-vif-deleted-bad0d981-8983-4cd7-9852-d09f8956d372 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:54:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:53 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:54:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:54:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:54:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:54:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:54:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:54:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:55:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:55:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:55:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291286.9418967, ecb96343-9e44-442e-a14f-41a2f82e7a50 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:02 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] VM Stopped (Lifecycle Event)
Aug 17 16:55:02 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:02 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8865MB free_disk=25.522701263427734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-654e9543-e4d5-41a1-a5eb-97fde381d597 None None] [instance: ecb96343-9e44-442e-a14f-41a2f82e7a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:55:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:55:13 user nova-compute[72724]: INFO nova.compute.claims [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Claim successful on node user
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.175s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:55:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.policy [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '614e07eba6ae432598427f2e4f256165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7338ba99b04595b7ff8ceca1951aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:55:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Creating image(s)
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.106s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.167s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk 1073741824" returned: 0 in 0.060s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Successfully created port: dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Cannot resize image /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'migration_context' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Ensure instance console log exists: /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Successfully updated port: dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-changed-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Refreshing instance network info cache due to event network-changed-dec2f741-cbae-4a79-bf4f-86010a9c9971. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:55:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance network_info: |[{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Refreshing network info cache for port dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start _get_guest_xml network_info=[{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:55:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:55:16 user nova-compute[72724]:   <uuid>8d21072e-5280-4475-8174-2cc84278cfaa</uuid>
Aug 17 16:55:16 user nova-compute[72724]:   <name>instance-00000027</name>
Aug 17 16:55:16 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:55:16 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:55:16 user nova-compute[72724]:   <metadata>
Aug 17 16:55:16 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:55:16 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:55:16 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeTestJSON-server-11543544</nova:name>
Aug 17 16:55:16 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:55:16</nova:creationTime>
Aug 17 16:55:16 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:55:16 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:55:16 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:55:16 user nova-compute[72724]:       <nova:owner>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:user uuid="614e07eba6ae432598427f2e4f256165">tempest-AttachVolumeTestJSON-921709659-project-member</nova:user>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:project uuid="7d7338ba99b04595b7ff8ceca1951aea">tempest-AttachVolumeTestJSON-921709659</nova:project>
Aug 17 16:55:16 user nova-compute[72724]:       </nova:owner>
Aug 17 16:55:16 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:55:16 user nova-compute[72724]:       <nova:ports>
Aug 17 16:55:16 user nova-compute[72724]:         <nova:port uuid="dec2f741-cbae-4a79-bf4f-86010a9c9971">
Aug 17 16:55:16 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 16:55:16 user nova-compute[72724]:         </nova:port>
Aug 17 16:55:16 user nova-compute[72724]:       </nova:ports>
Aug 17 16:55:16 user nova-compute[72724]:     </nova:instance>
Aug 17 16:55:16 user nova-compute[72724]:   </metadata>
Aug 17 16:55:16 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:55:16 user nova-compute[72724]:     <system>
Aug 17 16:55:16 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:55:16 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:55:16 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:55:16 user nova-compute[72724]:       <entry name="serial">8d21072e-5280-4475-8174-2cc84278cfaa</entry>
Aug 17 16:55:16 user nova-compute[72724]:       <entry name="uuid">8d21072e-5280-4475-8174-2cc84278cfaa</entry>
Aug 17 16:55:16 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:55:16 user nova-compute[72724]:     </system>
Aug 17 16:55:16 user nova-compute[72724]:   </sysinfo>
Aug 17 16:55:16 user nova-compute[72724]:   <os>
Aug 17 16:55:16 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:55:16 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:55:16 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:55:16 user nova-compute[72724]:   </os>
Aug 17 16:55:16 user nova-compute[72724]:   <features>
Aug 17 16:55:16 user nova-compute[72724]:     <acpi/>
Aug 17 16:55:16 user nova-compute[72724]:     <apic/>
Aug 17 16:55:16 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:55:16 user nova-compute[72724]:   </features>
Aug 17 16:55:16 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:55:16 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:55:16 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:55:16 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:55:16 user nova-compute[72724]:   </clock>
Aug 17 16:55:16 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:55:16 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:55:16 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:55:16 user nova-compute[72724]:   </cpu>
Aug 17 16:55:16 user nova-compute[72724]:   <devices>
Aug 17 16:55:16 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:55:16 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:55:16 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk"/>
Aug 17 16:55:16 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:55:16 user nova-compute[72724]:     </disk>
Aug 17 16:55:16 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:55:16 user nova-compute[72724]:       <mac address="fa:16:3e:c1:84:d3"/>
Aug 17 16:55:16 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:55:16 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:55:16 user nova-compute[72724]:       <target dev="tapdec2f741-cb"/>
Aug 17 16:55:16 user nova-compute[72724]:     </interface>
Aug 17 16:55:16 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:55:16 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/console.log" append="off"/>
Aug 17 16:55:16 user nova-compute[72724]:     </serial>
Aug 17 16:55:16 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:55:16 user nova-compute[72724]:     <video>
Aug 17 16:55:16 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:55:16 user nova-compute[72724]:     </video>
Aug 17 16:55:16 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:55:16 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:55:16 user nova-compute[72724]:     </rng>
Aug 17 16:55:16 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:55:16 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:55:16 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:55:16 user nova-compute[72724]:     </memballoon>
Aug 17 16:55:16 user nova-compute[72724]:   </devices>
Aug 17 16:55:16 user nova-compute[72724]: </domain>
Aug 17 16:55:16 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:55:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG os_vif [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec2f741-cb, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdec2f741-cb, col_values=(('external_ids', {'iface-id': 'dec2f741-cbae-4a79-bf4f-86010a9c9971', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:84:d3', 'vm-uuid': '8d21072e-5280-4475-8174-2cc84278cfaa'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:16 user nova-compute[72724]: INFO os_vif [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb')
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No VIF found with MAC fa:16:3e:c1:84:d3, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated VIF entry in instance network info cache for port dec2f741-cbae-4a79-bf4f-86010a9c9971. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f66a4b4a-a6ee-4278-ad8c-c2e2ea736972 req-f7cdce7b-8e46-4458-a0f0-62f2c98d277c service nova] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:55:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c3d08c7-e01b-4ef6-85b0-17d7695383a9 req-7cb066fc-b7dd-42dc-a970-67003c225d02 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c3d08c7-e01b-4ef6-85b0-17d7695383a9 req-7cb066fc-b7dd-42dc-a970-67003c225d02 service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c3d08c7-e01b-4ef6-85b0-17d7695383a9 req-7cb066fc-b7dd-42dc-a970-67003c225d02 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c3d08c7-e01b-4ef6-85b0-17d7695383a9 req-7cb066fc-b7dd-42dc-a970-67003c225d02 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c3d08c7-e01b-4ef6-85b0-17d7695383a9 req-7cb066fc-b7dd-42dc-a970-67003c225d02 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:55:17 user nova-compute[72724]: WARNING nova.compute.manager [req-9c3d08c7-e01b-4ef6-85b0-17d7695383a9 req-7cb066fc-b7dd-42dc-a970-67003c225d02 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state building and task_state spawning.
Aug 17 16:55:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-20021db7-0cec-473a-af05-71c01920ae10 req-54159bfc-63a5-4bf9-b915-755a28ef035f service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-20021db7-0cec-473a-af05-71c01920ae10 req-54159bfc-63a5-4bf9-b915-755a28ef035f service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-20021db7-0cec-473a-af05-71c01920ae10 req-54159bfc-63a5-4bf9-b915-755a28ef035f service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-20021db7-0cec-473a-af05-71c01920ae10 req-54159bfc-63a5-4bf9-b915-755a28ef035f service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-20021db7-0cec-473a-af05-71c01920ae10 req-54159bfc-63a5-4bf9-b915-755a28ef035f service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:55:20 user nova-compute[72724]: WARNING nova.compute.manager [req-20021db7-0cec-473a-af05-71c01920ae10 req-54159bfc-63a5-4bf9-b915-755a28ef035f service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state building and task_state spawning.
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.claims [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Claim successful on node user
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291320.1554346, 8d21072e-5280-4475-8174-2cc84278cfaa => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Resumed (Lifecycle Event)
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance spawned successfully.
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291320.1569247, 8d21072e-5280-4475-8174-2cc84278cfaa => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Started (Lifecycle Event)
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Took 6.48 seconds to spawn the instance on the hypervisor.
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.413s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.compute.manager [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Took 6.98 seconds to build instance.
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bb1bcb3-0cff-4619-b60a-8e7d197f1e75 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.070s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:55:20 user nova-compute[72724]: INFO nova.virt.block_device [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Booting with volume 792dac02-c4a2-4135-ba9b-3779dde2952d at /dev/vda
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.policy [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0bf0e273cd41469598c56db22d01e858', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7978b8f6d71449118dea5720c404771f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG os_brick.utils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a090cd-f0ca-4439-92d4-7c3c3b256a1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[627bd0c6-d580-4ed6-9312-6b7404e4c628]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e07ae2f-9c43-4396-b3b7-010a3e506378]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8636b-75bd-4f5d-9153-9faeb49dc02f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:55:20 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:55:20 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e100996-9722-4775-86e7-5480ddfaaed9]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG os_brick.utils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:55:20 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating existing volume attachment record: 570814ce-e942-49df-99e9-9d4cbb13c1d0 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:55:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Successfully created port: 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:55:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Successfully updated port: 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing instance network info cache due to event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance network_info: |[{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:55:22 user nova-compute[72724]: DEBUG nova.network.neutron [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:55:23 user nova-compute[72724]: DEBUG nova.network.neutron [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updated VIF entry in instance network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:55:23 user nova-compute[72724]: DEBUG nova.network.neutron [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:55:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bb83b6af-94a8-4385-a2c6-beccd3b2b4ef req-0bd0eaf4-191e-453a-87b7-b81cb0f42c1b service nova] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:55:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:55:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Creating image(s)
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Ensure instance console log exists: /opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Start _get_guest_xml network_info=[{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '570814ce-e942-49df-99e9-9d4cbb13c1d0', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4d85ead-e395-4cf3-b9c3-ac02da1e7236', 'attached_at': '', 'detached_at': '', 'volume_id': '792dac02-c4a2-4135-ba9b-3779dde2952d', 'serial': '792dac02-c4a2-4135-ba9b-3779dde2952d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:55:31 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:31 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:55:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:55:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:55:31 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a00e77-15e3-486d-a6c6-6cb3a414e9b2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:55:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f319da1-1c1a-4cb7-bc8e-49844b06b4b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d] added
Aug 17 16:55:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c59e5f-06d4-44a5-b1f3-13655d0d4abb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0cc6d9-e0c1-4299-99ea-4b0183cc4c62]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDROVlWN {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDROVlWN" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b98922-9778-4035-a2b9-5d70b98ad706]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nDROVlWN'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d18c37a-0b78-4cf1-b624-e2afd9fa3c6e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaa1a67-7465-4a73-893a-f6b6a064f91d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:55:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:55:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:55:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 16:55:31 user nova-compute[72724]: 
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8324cd2-13cf-42dd-ba3b-ce0642b8f14e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]
Aug 17 16:55:31 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.
Aug 17 16:55:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5112b34-e6fd-4d9f-9a1e-6dc1b8a458d6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d2f05d-7f4f-4ba9-8ba3-bf7bb57b7dfe]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:55:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:55:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2a3f8b-da81-448c-af34-d2660b8213f1]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:55:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26337393235636537', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337393235636537', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-827051074',display_name='tempest-TestShelveInstance-server-827051074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-827051074',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkAtFiiT01dCXwZFFS358H9yrMuYYtoc6LR3/ps5B7MHf7MQf0fGzTfPAzpfHZJLXSxbXGD/lDYizQr8VwHv4JIyo1Sgfz29Pr5e79oNgdT6MKcVRB8U8vbJeOwKNnzaA==',key_name='tempest-TestShelveInstance-895857359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7978b8f6d71449118dea5720c404771f',ramdisk_id='',reservation_id='r-zfcdeewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-13891976',owner_user_name='tempest-TestShelveInstance-13891976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:55:21Z,user_data=None,user_id='0bf0e273cd41469598c56db22d01e858',uuid=c4d85ead-e395-4cf3-b9c3-ac02da1e7236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converting VIF {"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.objects.instance [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'pci_devices' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:55:32 user nova-compute[72724]:   <uuid>c4d85ead-e395-4cf3-b9c3-ac02da1e7236</uuid>
Aug 17 16:55:32 user nova-compute[72724]:   <name>instance-00000028</name>
Aug 17 16:55:32 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:55:32 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:55:32 user nova-compute[72724]:   <metadata>
Aug 17 16:55:32 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:55:32 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:55:32 user nova-compute[72724]:       <nova:name>tempest-TestShelveInstance-server-827051074</nova:name>
Aug 17 16:55:32 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:55:31</nova:creationTime>
Aug 17 16:55:32 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:55:32 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:55:32 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:55:32 user nova-compute[72724]:       <nova:owner>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:user uuid="0bf0e273cd41469598c56db22d01e858">tempest-TestShelveInstance-13891976-project-member</nova:user>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:project uuid="7978b8f6d71449118dea5720c404771f">tempest-TestShelveInstance-13891976</nova:project>
Aug 17 16:55:32 user nova-compute[72724]:       </nova:owner>
Aug 17 16:55:32 user nova-compute[72724]:       <nova:ports>
Aug 17 16:55:32 user nova-compute[72724]:         <nova:port uuid="68cb566f-f44c-402f-ad9b-da672fc8dc45">
Aug 17 16:55:32 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:55:32 user nova-compute[72724]:         </nova:port>
Aug 17 16:55:32 user nova-compute[72724]:       </nova:ports>
Aug 17 16:55:32 user nova-compute[72724]:     </nova:instance>
Aug 17 16:55:32 user nova-compute[72724]:   </metadata>
Aug 17 16:55:32 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:55:32 user nova-compute[72724]:     <system>
Aug 17 16:55:32 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:55:32 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:55:32 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:55:32 user nova-compute[72724]:       <entry name="serial">c4d85ead-e395-4cf3-b9c3-ac02da1e7236</entry>
Aug 17 16:55:32 user nova-compute[72724]:       <entry name="uuid">c4d85ead-e395-4cf3-b9c3-ac02da1e7236</entry>
Aug 17 16:55:32 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:55:32 user nova-compute[72724]:     </system>
Aug 17 16:55:32 user nova-compute[72724]:   </sysinfo>
Aug 17 16:55:32 user nova-compute[72724]:   <os>
Aug 17 16:55:32 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:55:32 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:55:32 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:55:32 user nova-compute[72724]:   </os>
Aug 17 16:55:32 user nova-compute[72724]:   <features>
Aug 17 16:55:32 user nova-compute[72724]:     <acpi/>
Aug 17 16:55:32 user nova-compute[72724]:     <apic/>
Aug 17 16:55:32 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:55:32 user nova-compute[72724]:   </features>
Aug 17 16:55:32 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:55:32 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:55:32 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:55:32 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:55:32 user nova-compute[72724]:   </clock>
Aug 17 16:55:32 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:55:32 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:55:32 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:55:32 user nova-compute[72724]:   </cpu>
Aug 17 16:55:32 user nova-compute[72724]:   <devices>
Aug 17 16:55:32 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:55:32 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:55:32 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:55:32 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:55:32 user nova-compute[72724]:       <serial>792dac02-c4a2-4135-ba9b-3779dde2952d</serial>
Aug 17 16:55:32 user nova-compute[72724]:     </disk>
Aug 17 16:55:32 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:55:32 user nova-compute[72724]:       <mac address="fa:16:3e:86:51:bf"/>
Aug 17 16:55:32 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:55:32 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:55:32 user nova-compute[72724]:       <target dev="tap68cb566f-f4"/>
Aug 17 16:55:32 user nova-compute[72724]:     </interface>
Aug 17 16:55:32 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:55:32 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236/console.log" append="off"/>
Aug 17 16:55:32 user nova-compute[72724]:     </serial>
Aug 17 16:55:32 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:55:32 user nova-compute[72724]:     <video>
Aug 17 16:55:32 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:55:32 user nova-compute[72724]:     </video>
Aug 17 16:55:32 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:55:32 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:55:32 user nova-compute[72724]:     </rng>
Aug 17 16:55:32 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:55:32 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:55:32 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:55:32 user nova-compute[72724]:     </memballoon>
Aug 17 16:55:32 user nova-compute[72724]:   </devices>
Aug 17 16:55:32 user nova-compute[72724]: </domain>
Aug 17 16:55:32 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-827051074',display_name='tempest-TestShelveInstance-server-827051074',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-827051074',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkAtFiiT01dCXwZFFS358H9yrMuYYtoc6LR3/ps5B7MHf7MQf0fGzTfPAzpfHZJLXSxbXGD/lDYizQr8VwHv4JIyo1Sgfz29Pr5e79oNgdT6MKcVRB8U8vbJeOwKNnzaA==',key_name='tempest-TestShelveInstance-895857359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7978b8f6d71449118dea5720c404771f',ramdisk_id='',reservation_id='r-zfcdeewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-13891976',owner_user_name='tempest-TestShelveInstance-13891976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:55:21Z,user_data=None,user_id='0bf0e273cd41469598c56db22d01e858',uuid=c4d85ead-e395-4cf3-b9c3-ac02da1e7236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converting VIF {"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG os_vif [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68cb566f-f4, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68cb566f-f4, col_values=(('external_ids', {'iface-id': '68cb566f-f44c-402f-ad9b-da672fc8dc45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:51:bf', 'vm-uuid': 'c4d85ead-e395-4cf3-b9c3-ac02da1e7236'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:55:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:32 user nova-compute[72724]: INFO os_vif [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4')
Aug 17 16:55:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:55:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] No VIF found with MAC fa:16:3e:86:51:bf, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-4adbed1e-0a09-4584-b11f-38871979dce0 req-7837c012-991c-4704-9efa-a6d972d07daf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4adbed1e-0a09-4584-b11f-38871979dce0 req-7837c012-991c-4704-9efa-a6d972d07daf service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4adbed1e-0a09-4584-b11f-38871979dce0 req-7837c012-991c-4704-9efa-a6d972d07daf service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4adbed1e-0a09-4584-b11f-38871979dce0 req-7837c012-991c-4704-9efa-a6d972d07daf service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:34 user nova-compute[72724]: DEBUG nova.compute.manager [req-4adbed1e-0a09-4584-b11f-38871979dce0 req-7837c012-991c-4704-9efa-a6d972d07daf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:55:34 user nova-compute[72724]: WARNING nova.compute.manager [req-4adbed1e-0a09-4584-b11f-38871979dce0 req-7837c012-991c-4704-9efa-a6d972d07daf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state building and task_state spawning.
Aug 17 16:55:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291336.7109036, c4d85ead-e395-4cf3-b9c3-ac02da1e7236 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] VM Resumed (Lifecycle Event)
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance spawned successfully.
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291336.7175505, c4d85ead-e395-4cf3-b9c3-ac02da1e7236 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] VM Started (Lifecycle Event)
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee47264f-7ac7-4f2a-841f-b5fb5e4190d4 req-7885a50f-6db7-4aa9-bb38-11b67859d433 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee47264f-7ac7-4f2a-841f-b5fb5e4190d4 req-7885a50f-6db7-4aa9-bb38-11b67859d433 service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee47264f-7ac7-4f2a-841f-b5fb5e4190d4 req-7885a50f-6db7-4aa9-bb38-11b67859d433 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee47264f-7ac7-4f2a-841f-b5fb5e4190d4 req-7885a50f-6db7-4aa9-bb38-11b67859d433 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee47264f-7ac7-4f2a-841f-b5fb5e4190d4 req-7885a50f-6db7-4aa9-bb38-11b67859d433 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:55:36 user nova-compute[72724]: WARNING nova.compute.manager [req-ee47264f-7ac7-4f2a-841f-b5fb5e4190d4 req-7885a50f-6db7-4aa9-bb38-11b67859d433 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state building and task_state spawning.
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:55:36 user nova-compute[72724]: INFO nova.compute.manager [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Took 16.88 seconds to build instance.
Aug 17 16:55:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-22a9a9c5-e82f-470d-85fc-d0ba6afa0088 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.008s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:55:40 user nova-compute[72724]: INFO nova.compute.claims [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Claim successful on node user
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.network.neutron [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:55:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.policy [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd05a8d77a3b04cc783d6ef9fdea15526', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5d8a38870654abe8b40aeb3ee406293', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:55:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Creating image(s)
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "/opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk 1073741824" returned: 0 in 0.054s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Cannot resize image /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'migration_context' on Instance uuid cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Ensure instance console log exists: /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:42 user nova-compute[72724]: DEBUG nova.network.neutron [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Successfully created port: c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:55:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Successfully updated port: c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquired lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-changed-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.compute.manager [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Refreshing instance network info cache due to event network-changed-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] Acquiring lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.neutron [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating instance_info_cache with network_info: [{"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Releasing lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Instance network_info: |[{"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] Acquired lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.neutron [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Refreshing network info cache for port c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Start _get_guest_xml network_info=[{"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:55:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:43 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1715839882',display_name='tempest-AttachVolumeNegativeTest-server-1715839882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1715839882',id=41,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkJBH3rtdzpyu8unrR4b6lXC2hy4Bc977me00w7Q7y83WGj1Aj531WHO0BZ6uQ/O+eQo0NQGbkO4yuUqiB+3CGhOHKqwWGT4U6FfRe5qwXtozqp/DWe7nVM7PmdaC82dA==',key_name='tempest-keypair-1703150481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-z3gxt00j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=cf4da440-8bdd-40c8-99d0-dc7088e76cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.objects.instance [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'pci_devices' on Instance uuid cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:55:43 user nova-compute[72724]:   <uuid>cf4da440-8bdd-40c8-99d0-dc7088e76cff</uuid>
Aug 17 16:55:43 user nova-compute[72724]:   <name>instance-00000029</name>
Aug 17 16:55:43 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:55:43 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:55:43 user nova-compute[72724]:   <metadata>
Aug 17 16:55:43 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:55:43 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:55:43 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1715839882</nova:name>
Aug 17 16:55:43 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:55:43</nova:creationTime>
Aug 17 16:55:43 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:55:43 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:55:43 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:55:43 user nova-compute[72724]:       <nova:owner>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:user uuid="d05a8d77a3b04cc783d6ef9fdea15526">tempest-AttachVolumeNegativeTest-1491105836-project-member</nova:user>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:project uuid="d5d8a38870654abe8b40aeb3ee406293">tempest-AttachVolumeNegativeTest-1491105836</nova:project>
Aug 17 16:55:43 user nova-compute[72724]:       </nova:owner>
Aug 17 16:55:43 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:55:43 user nova-compute[72724]:       <nova:ports>
Aug 17 16:55:43 user nova-compute[72724]:         <nova:port uuid="c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016">
Aug 17 16:55:43 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 17 16:55:43 user nova-compute[72724]:         </nova:port>
Aug 17 16:55:43 user nova-compute[72724]:       </nova:ports>
Aug 17 16:55:43 user nova-compute[72724]:     </nova:instance>
Aug 17 16:55:43 user nova-compute[72724]:   </metadata>
Aug 17 16:55:43 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:55:43 user nova-compute[72724]:     <system>
Aug 17 16:55:43 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:55:43 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:55:43 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:55:43 user nova-compute[72724]:       <entry name="serial">cf4da440-8bdd-40c8-99d0-dc7088e76cff</entry>
Aug 17 16:55:43 user nova-compute[72724]:       <entry name="uuid">cf4da440-8bdd-40c8-99d0-dc7088e76cff</entry>
Aug 17 16:55:43 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:55:43 user nova-compute[72724]:     </system>
Aug 17 16:55:43 user nova-compute[72724]:   </sysinfo>
Aug 17 16:55:43 user nova-compute[72724]:   <os>
Aug 17 16:55:43 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:55:43 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:55:43 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:55:43 user nova-compute[72724]:   </os>
Aug 17 16:55:43 user nova-compute[72724]:   <features>
Aug 17 16:55:43 user nova-compute[72724]:     <acpi/>
Aug 17 16:55:43 user nova-compute[72724]:     <apic/>
Aug 17 16:55:43 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:55:43 user nova-compute[72724]:   </features>
Aug 17 16:55:43 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:55:43 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:55:43 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:55:43 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:55:43 user nova-compute[72724]:   </clock>
Aug 17 16:55:43 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:55:43 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:55:43 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:55:43 user nova-compute[72724]:   </cpu>
Aug 17 16:55:43 user nova-compute[72724]:   <devices>
Aug 17 16:55:43 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:55:43 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:55:43 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk"/>
Aug 17 16:55:43 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:55:43 user nova-compute[72724]:     </disk>
Aug 17 16:55:43 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:55:43 user nova-compute[72724]:       <mac address="fa:16:3e:78:af:2c"/>
Aug 17 16:55:43 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:55:43 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:55:43 user nova-compute[72724]:       <target dev="tapc5fbd61c-12"/>
Aug 17 16:55:43 user nova-compute[72724]:     </interface>
Aug 17 16:55:43 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:55:43 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/console.log" append="off"/>
Aug 17 16:55:43 user nova-compute[72724]:     </serial>
Aug 17 16:55:43 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:55:43 user nova-compute[72724]:     <video>
Aug 17 16:55:43 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:55:43 user nova-compute[72724]:     </video>
Aug 17 16:55:43 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:55:43 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:55:43 user nova-compute[72724]:     </rng>
Aug 17 16:55:43 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:55:43 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:55:43 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:55:43 user nova-compute[72724]:     </memballoon>
Aug 17 16:55:43 user nova-compute[72724]:   </devices>
Aug 17 16:55:43 user nova-compute[72724]: </domain>
Aug 17 16:55:43 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1715839882',display_name='tempest-AttachVolumeNegativeTest-server-1715839882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1715839882',id=41,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkJBH3rtdzpyu8unrR4b6lXC2hy4Bc977me00w7Q7y83WGj1Aj531WHO0BZ6uQ/O+eQo0NQGbkO4yuUqiB+3CGhOHKqwWGT4U6FfRe5qwXtozqp/DWe7nVM7PmdaC82dA==',key_name='tempest-keypair-1703150481',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-z3gxt00j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:55:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=cf4da440-8bdd-40c8-99d0-dc7088e76cff,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG os_vif [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc5fbd61c-12, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc5fbd61c-12, col_values=(('external_ids', {'iface-id': 'c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:af:2c', 'vm-uuid': 'cf4da440-8bdd-40c8-99d0-dc7088e76cff'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:43 user nova-compute[72724]: INFO os_vif [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12')
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:55:43 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:78:af:2c, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:55:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updated VIF entry in instance network info cache for port c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:55:44 user nova-compute[72724]: DEBUG nova.network.neutron [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating instance_info_cache with network_info: [{"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:55:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fa0dc123-8e24-4075-a2df-15ed30f9da14 req-26a92694-9031-4225-a9a2-71250ac06131 service nova] Releasing lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-fdf8c5bd-14f5-4897-8521-fadf2a02aa6a req-d613a2f4-bdd0-4eb0-8592-b89d93fb42e7 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fdf8c5bd-14f5-4897-8521-fadf2a02aa6a req-d613a2f4-bdd0-4eb0-8592-b89d93fb42e7 service nova] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fdf8c5bd-14f5-4897-8521-fadf2a02aa6a req-d613a2f4-bdd0-4eb0-8592-b89d93fb42e7 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fdf8c5bd-14f5-4897-8521-fadf2a02aa6a req-d613a2f4-bdd0-4eb0-8592-b89d93fb42e7 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG nova.compute.manager [req-fdf8c5bd-14f5-4897-8521-fadf2a02aa6a req-d613a2f4-bdd0-4eb0-8592-b89d93fb42e7 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] No waiting events found dispatching network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:55:45 user nova-compute[72724]: WARNING nova.compute.manager [req-fdf8c5bd-14f5-4897-8521-fadf2a02aa6a req-d613a2f4-bdd0-4eb0-8592-b89d93fb42e7 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received unexpected event network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 for instance with vm_state building and task_state spawning.
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291347.398072, cf4da440-8bdd-40c8-99d0-dc7088e76cff => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] VM Resumed (Lifecycle Event)
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Instance spawned successfully.
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291347.3984802, cf4da440-8bdd-40c8-99d0-dc7088e76cff => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] VM Started (Lifecycle Event)
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Took 6.59 seconds to spawn the instance on the hypervisor.
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-c1981a3d-0f8f-497d-a7cd-ea82e41c62d4 req-3968a964-10ca-48bd-a2cc-28131ffb0508 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c1981a3d-0f8f-497d-a7cd-ea82e41c62d4 req-3968a964-10ca-48bd-a2cc-28131ffb0508 service nova] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c1981a3d-0f8f-497d-a7cd-ea82e41c62d4 req-3968a964-10ca-48bd-a2cc-28131ffb0508 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-c1981a3d-0f8f-497d-a7cd-ea82e41c62d4 req-3968a964-10ca-48bd-a2cc-28131ffb0508 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:47 user nova-compute[72724]: DEBUG nova.compute.manager [req-c1981a3d-0f8f-497d-a7cd-ea82e41c62d4 req-3968a964-10ca-48bd-a2cc-28131ffb0508 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] No waiting events found dispatching network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:55:47 user nova-compute[72724]: WARNING nova.compute.manager [req-c1981a3d-0f8f-497d-a7cd-ea82e41c62d4 req-3968a964-10ca-48bd-a2cc-28131ffb0508 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received unexpected event network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 for instance with vm_state building and task_state spawning.
Aug 17 16:55:47 user nova-compute[72724]: INFO nova.compute.manager [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Took 7.22 seconds to build instance.
Aug 17 16:55:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-94afb6dd-fca2-494d-9671-a3bfff996292 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.454s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:55:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:55:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:55:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:56:01 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:56:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:56:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:56:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:56:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:56:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:56:04 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:56:04 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:56:04 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8345MB free_disk=25.46225357055664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:56:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4d85ead-e395-4cf3-b9c3-ac02da1e7236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cf4da440-8bdd-40c8-99d0-dc7088e76cff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:56:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:56:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:56:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:56:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:56:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:56:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:56:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:56:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:56:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:56:59 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:57:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:57:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:57:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:57:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:57:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:57:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-changed-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG nova.compute.manager [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Refreshing instance network info cache due to event network-changed-dec2f741-cbae-4a79-bf4f-86010a9c9971. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG nova.network.neutron [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Refreshing network info cache for port dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG nova.network.neutron [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated VIF entry in instance network info cache for port dec2f741-cbae-4a79-bf4f-86010a9c9971. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG nova.network.neutron [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-2c849656-460f-4258-adf2-f07aeae0fc43 req-f2d234aa-75d7-4e46-b004-6a95b1b97677 service nova] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:06 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:57:06 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=25.45899200439453GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4d85ead-e395-4cf3-b9c3-ac02da1e7236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cf4da440-8bdd-40c8-99d0-dc7088e76cff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.273s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:09 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:10 user nova-compute[72724]: INFO nova.compute.manager [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Attaching volume 3604ff93-2abd-4f88-89b1-41187374e2d0 to /dev/vdb
Aug 17 16:57:10 user nova-compute[72724]: DEBUG os_brick.utils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a691e114-16b2-4302-9938-2e03eac1d8bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ba3a1-e3ea-40ae-97b6-11cba091b480]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[adee87b9-eec3-45be-9f3c-f4a2eaec1423]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6744331f-8096-4c9c-bc2b-73a00d33e576]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:57:10 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:57:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde2d25e-0d25-4fd0-95b3-fe1b332dbad6]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG os_brick.utils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:57:10 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating existing volume attachment record: ca849199-3cbe-4b5e-b1fc-243a32a1b4b9 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:57:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing instance network info cache due to event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG nova.network.neutron [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:12 user nova-compute[72724]: INFO nova.compute.manager [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Shelve offloading
Aug 17 16:57:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG nova.network.neutron [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updated VIF entry in instance network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG nova.network.neutron [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-640865f0-33fa-4b2d-8f99-014ab4c2fd95 req-6d7f53ac-d724-41b8-b3b2-6e4ff342b90f service nova] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-e1e2f5c4-7286-4539-8b6d-038675fbd067 req-cf7d77e4-0203-4766-90bb-5c4417daf159 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-unplugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e1e2f5c4-7286-4539-8b6d-038675fbd067 req-cf7d77e4-0203-4766-90bb-5c4417daf159 service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e1e2f5c4-7286-4539-8b6d-038675fbd067 req-cf7d77e4-0203-4766-90bb-5c4417daf159 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e1e2f5c4-7286-4539-8b6d-038675fbd067 req-cf7d77e4-0203-4766-90bb-5c4417daf159 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG nova.compute.manager [req-e1e2f5c4-7286-4539-8b6d-038675fbd067 req-cf7d77e4-0203-4766-90bb-5c4417daf159 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-unplugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:57:13 user nova-compute[72724]: WARNING nova.compute.manager [req-e1e2f5c4-7286-4539-8b6d-038675fbd067 req-cf7d77e4-0203-4766-90bb-5c4417daf159 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-unplugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state active and task_state shelving.
Aug 17 16:57:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance destroyed successfully.
Aug 17 16:57:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:57:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance destroyed successfully.
Aug 17 16:57:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'resources' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-827051074',display_name='tempest-TestShelveInstance-server-827051074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-827051074',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkAtFiiT01dCXwZFFS358H9yrMuYYtoc6LR3/ps5B7MHf7MQf0fGzTfPAzpfHZJLXSxbXGD/lDYizQr8VwHv4JIyo1Sgfz29Pr5e79oNgdT6MKcVRB8U8vbJeOwKNnzaA==',key_name='tempest-TestShelveInstance-895857359',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7978b8f6d71449118dea5720c404771f',ramdisk_id='',reservation_id='r-zfcdeewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-13891976',owner_user_name='tempest-TestShelveInstance-13891976-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:55:37Z,user_data=None,user_id='0bf0e273cd41469598c56db22d01e858',uuid=c4d85ead-e395-4cf3-b9c3-ac02da1e7236,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converting VIF {"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_vif [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68cb566f-f4, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:57:14 user nova-compute[72724]: INFO os_vif [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4')
Aug 17 16:57:14 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:57:14 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afd3210-6bc7-4ce9-b0d1-227a3b7cc45a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f445fd-c1ce-4c34-8373-d1b23e65f674]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:57:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:57:14 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8598940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:57:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fc1e52-ddb6-4525-b26c-038311f75bb3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c195ab7-387d-48ff-957b-a21abb3fc546]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a3cd58-b10f-4de3-940b-69d4bccff3d3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ae9ca5-2ce3-4654-8426-6114f2fb41fe]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c15686be-eb5c-4c17-936e-7a255dcfd9a9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46c43cd-9a3a-4f01-b35b-037de636d669]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]
Aug 17 16:57:15 user nova-compute[72724]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.
Aug 17 16:57:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a144c26-70c6-4516-bc42-3abfbe4eb488]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] <== disconnect_volume: return (277ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:57:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Deleting instance files /opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236_del
Aug 17 16:57:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Deletion of /opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236_del complete
Aug 17 16:57:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:57:15 user nova-compute[72724]: WARNING nova.compute.manager [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state active and task_state shelving.
Aug 17 16:57:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing instance network info cache due to event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:15 user nova-compute[72724]: DEBUG nova.network.neutron [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:57:16 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Deleted allocations for instance c4d85ead-e395-4cf3-b9c3-ac02da1e7236
Aug 17 16:57:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'numa_topology' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-266a3caf-aa3f-445b-9864-90457de5340b tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.755s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updated VIF entry in instance network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": null, "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap68cb566f-f4", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9cbd46c2-4df2-4af7-b4a9-574f9ad39bba req-adb08dc5-d4c5-43ae-b3c5-6ee9f274c8b9 service nova] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:57:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:57:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:57:21 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[426ff2a7-4928-4474-8841-bf5d2538af87]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:57:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f804490-f842-4f52-8d5b-e00a519dc02a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0] added
Aug 17 16:57:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c89883-a5ec-4ceb-bcc3-856e68248c6c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9d72577-df63-40aa-ac36-3a2df4ee9ee0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gULyxRAC {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verify base images {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Image id 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 yields fingerprint b03bde4555170889934ac3c361a174084018845b {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 16:57:21 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] image 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 at (/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b): checking
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] image 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 at (/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b): image is in use {{(pid=72724) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] cf4da440-8bdd-40c8-99d0-dc7088e76cff is a valid instance name {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] cf4da440-8bdd-40c8-99d0-dc7088e76cff has a disk file {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gULyxRAC" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b154f4d0-674a-4ca9-856b-92539eb0cb94]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gULyxRAC'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.081s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa4baba-2a44-42d9-a851-944e205985d1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80872db-8799-4ed2-9f0f-9ab4e9193cf4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:57:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:57:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:57:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 16:57:21 user nova-compute[72724]: 
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cf4da440-8bdd-40c8-99d0-dc7088e76cff is backed by b03bde4555170889934ac3c361a174084018845b {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] 8d21072e-5280-4475-8174-2cc84278cfaa is a valid instance name {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] 8d21072e-5280-4475-8174-2cc84278cfaa has a disk file {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a2b237-73e3-4aef-8a23-6f2b4bf8debe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]
Aug 17 16:57:21 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.
Aug 17 16:57:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bafceaf-8c35-41e5-b5b3-06a016c671f1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ff7ff5-d1d5-43cf-94ce-a15ac85432ae]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ffa8db-b551-48ac-8d8f-3979298d41ab]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa is backed by b03bde4555170889934ac3c361a174084018845b {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce
Aug 17 16:57:22 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Active base files: /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Removable base files: /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9 /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110 /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce
Aug 17 16:57:22 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8
Aug 17 16:57:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verification complete {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verify swap images {{(pid=72724) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 16:57:22 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verify ephemeral images {{(pid=72724) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.456s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== connect_volume: return (1457ms) {'type': 'block', 'scsi_wwn': '26163653064323966', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163653064323966', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:57:23 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:57:23 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 16:57:23 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:57:23 user nova-compute[72724]:   <serial>3604ff93-2abd-4f88-89b1-41187374e2d0</serial>
Aug 17 16:57:23 user nova-compute[72724]: </disk>
Aug 17 16:57:23 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No VIF found with MAC fa:16:3e:c1:84:d3, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:57:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0ebfb2b-50f9-4dff-9d2b-08351eaed713 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.406s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72724) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-17195d9a-edd2-454c-b3bd-1edb06c187dd req-93b50a5e-89a7-41c8-b858-85762cd22f9a service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17195d9a-edd2-454c-b3bd-1edb06c187dd req-93b50a5e-89a7-41c8-b858-85762cd22f9a service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17195d9a-edd2-454c-b3bd-1edb06c187dd req-93b50a5e-89a7-41c8-b858-85762cd22f9a service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-17195d9a-edd2-454c-b3bd-1edb06c187dd req-93b50a5e-89a7-41c8-b858-85762cd22f9a service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-17195d9a-edd2-454c-b3bd-1edb06c187dd req-93b50a5e-89a7-41c8-b858-85762cd22f9a service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:57:24 user nova-compute[72724]: WARNING nova.compute.manager [req-17195d9a-edd2-454c-b3bd-1edb06c187dd req-93b50a5e-89a7-41c8-b858-85762cd22f9a service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state active and task_state powering-off.
Aug 17 16:57:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:25 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance destroyed successfully.
Aug 17 16:57:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-b4df833f-2de5-464d-8ba0-6d150fe58432 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.858s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-db1072e2-b07e-42ad-aa3d-e0b913940b60 req-8f514a14-ca85-460e-af9c-1b671bf8200e service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-db1072e2-b07e-42ad-aa3d-e0b913940b60 req-8f514a14-ca85-460e-af9c-1b671bf8200e service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-db1072e2-b07e-42ad-aa3d-e0b913940b60 req-8f514a14-ca85-460e-af9c-1b671bf8200e service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-db1072e2-b07e-42ad-aa3d-e0b913940b60 req-8f514a14-ca85-460e-af9c-1b671bf8200e service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-db1072e2-b07e-42ad-aa3d-e0b913940b60 req-8f514a14-ca85-460e-af9c-1b671bf8200e service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:57:26 user nova-compute[72724]: WARNING nova.compute.manager [req-db1072e2-b07e-42ad-aa3d-e0b913940b60 req-8f514a14-ca85-460e-af9c-1b671bf8200e service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state stopped and task_state None.
Aug 17 16:57:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:28 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291433.6412547, c4d85ead-e395-4cf3-b9c3-ac02da1e7236 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:57:28 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] VM Stopped (Lifecycle Event)
Aug 17 16:57:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5ce2450a-9a10-42ff-942e-ad85585bbee2 None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-changed-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Refreshing instance network info cache due to event network-changed-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] Acquiring lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] Acquired lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG nova.network.neutron [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Refreshing network info cache for port c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:31 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:57:31 user nova-compute[72724]: INFO nova.compute.claims [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Claim successful on node user
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 16:57:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.network.neutron [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updated VIF entry in instance network info cache for port c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.network.neutron [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating instance_info_cache with network_info: [{"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.policy [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a006d33d2494c2fa8ac09b08721ee25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '566f2f793b834961a0ce8244e635e5df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a6c51e86-bc2e-43fd-b4c1-c4d799df81df req-d08dac63-5e6e-4349-9a89-d793c4922d49 service nova] Releasing lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:57:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Creating image(s)
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "/opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "/opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "/opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.315s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk 1073741824" returned: 0 in 0.052s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Successfully created port: c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Cannot resize image /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'migration_context' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Ensure instance console log exists: /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Successfully updated port: c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquired lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-changed-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Refreshing instance network info cache due to event network-changed-c4d94ba3-ac61-4785-a904-e5342a5c1eb5. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] Acquiring lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:57:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating instance_info_cache with network_info: [{"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Releasing lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Instance network_info: |[{"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] Acquired lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.neutron [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Refreshing network info cache for port c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Start _get_guest_xml network_info=[{"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:57:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:57:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1920291466',display_name='tempest-TestServerVolumeAttachmentScenario-server-1920291466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1920291466',id=42,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoq3wJx/bq/KVU2ylcC/PbSks06k1+lti2aBN+WOitto25NqFd5WZaw+iHPr1mfyssKsoiV5T7PC8bcwC66PqfBl2Qj6NXrVa6EIjTj2F97L+flElvaKR1tLdX9WJFmiA==',key_name='tempest-keypair-1046459166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='566f2f793b834961a0ce8244e635e5df',ramdisk_id='',reservation_id='r-frud9cuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-758837737',owner_user_name='tempest-TestServerVolumeAttachmentScenario-758837737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a006d33d2494c2fa8ac09b08721ee25',uuid=6671833d-ad40-4370-9438-30255c921676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Converting VIF {"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'pci_devices' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:57:34 user nova-compute[72724]:   <uuid>6671833d-ad40-4370-9438-30255c921676</uuid>
Aug 17 16:57:34 user nova-compute[72724]:   <name>instance-0000002a</name>
Aug 17 16:57:34 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:57:34 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:57:34 user nova-compute[72724]:   <metadata>
Aug 17 16:57:34 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:57:34 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:57:34 user nova-compute[72724]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1920291466</nova:name>
Aug 17 16:57:34 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:57:34</nova:creationTime>
Aug 17 16:57:34 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:57:34 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:57:34 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:57:34 user nova-compute[72724]:       <nova:owner>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:user uuid="9a006d33d2494c2fa8ac09b08721ee25">tempest-TestServerVolumeAttachmentScenario-758837737-project-member</nova:user>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:project uuid="566f2f793b834961a0ce8244e635e5df">tempest-TestServerVolumeAttachmentScenario-758837737</nova:project>
Aug 17 16:57:34 user nova-compute[72724]:       </nova:owner>
Aug 17 16:57:34 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:57:34 user nova-compute[72724]:       <nova:ports>
Aug 17 16:57:34 user nova-compute[72724]:         <nova:port uuid="c4d94ba3-ac61-4785-a904-e5342a5c1eb5">
Aug 17 16:57:34 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 17 16:57:34 user nova-compute[72724]:         </nova:port>
Aug 17 16:57:34 user nova-compute[72724]:       </nova:ports>
Aug 17 16:57:34 user nova-compute[72724]:     </nova:instance>
Aug 17 16:57:34 user nova-compute[72724]:   </metadata>
Aug 17 16:57:34 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:57:34 user nova-compute[72724]:     <system>
Aug 17 16:57:34 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:57:34 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:57:34 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:57:34 user nova-compute[72724]:       <entry name="serial">6671833d-ad40-4370-9438-30255c921676</entry>
Aug 17 16:57:34 user nova-compute[72724]:       <entry name="uuid">6671833d-ad40-4370-9438-30255c921676</entry>
Aug 17 16:57:34 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:57:34 user nova-compute[72724]:     </system>
Aug 17 16:57:34 user nova-compute[72724]:   </sysinfo>
Aug 17 16:57:34 user nova-compute[72724]:   <os>
Aug 17 16:57:34 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:57:34 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:57:34 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:57:34 user nova-compute[72724]:   </os>
Aug 17 16:57:34 user nova-compute[72724]:   <features>
Aug 17 16:57:34 user nova-compute[72724]:     <acpi/>
Aug 17 16:57:34 user nova-compute[72724]:     <apic/>
Aug 17 16:57:34 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:57:34 user nova-compute[72724]:   </features>
Aug 17 16:57:34 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:57:34 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:57:34 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:57:34 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:57:34 user nova-compute[72724]:   </clock>
Aug 17 16:57:34 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:57:34 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:57:34 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:57:34 user nova-compute[72724]:   </cpu>
Aug 17 16:57:34 user nova-compute[72724]:   <devices>
Aug 17 16:57:34 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:57:34 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:57:34 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk"/>
Aug 17 16:57:34 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:57:34 user nova-compute[72724]:     </disk>
Aug 17 16:57:34 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:57:34 user nova-compute[72724]:       <mac address="fa:16:3e:28:f8:f2"/>
Aug 17 16:57:34 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:57:34 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:57:34 user nova-compute[72724]:       <target dev="tapc4d94ba3-ac"/>
Aug 17 16:57:34 user nova-compute[72724]:     </interface>
Aug 17 16:57:34 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:57:34 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/console.log" append="off"/>
Aug 17 16:57:34 user nova-compute[72724]:     </serial>
Aug 17 16:57:34 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:57:34 user nova-compute[72724]:     <video>
Aug 17 16:57:34 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:57:34 user nova-compute[72724]:     </video>
Aug 17 16:57:34 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:57:34 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:57:34 user nova-compute[72724]:     </rng>
Aug 17 16:57:34 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:57:34 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:57:34 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:57:34 user nova-compute[72724]:     </memballoon>
Aug 17 16:57:34 user nova-compute[72724]:   </devices>
Aug 17 16:57:34 user nova-compute[72724]: </domain>
Aug 17 16:57:34 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1920291466',display_name='tempest-TestServerVolumeAttachmentScenario-server-1920291466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1920291466',id=42,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoq3wJx/bq/KVU2ylcC/PbSks06k1+lti2aBN+WOitto25NqFd5WZaw+iHPr1mfyssKsoiV5T7PC8bcwC66PqfBl2Qj6NXrVa6EIjTj2F97L+flElvaKR1tLdX9WJFmiA==',key_name='tempest-keypair-1046459166',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='566f2f793b834961a0ce8244e635e5df',ramdisk_id='',reservation_id='r-frud9cuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-758837737',owner_user_name='tempest-TestServerVolumeAttachmentScenario-758837737-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:57:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a006d33d2494c2fa8ac09b08721ee25',uuid=6671833d-ad40-4370-9438-30255c921676,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Converting VIF {"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG os_vif [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4d94ba3-ac, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc4d94ba3-ac, col_values=(('external_ids', {'iface-id': 'c4d94ba3-ac61-4785-a904-e5342a5c1eb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:f8:f2', 'vm-uuid': '6671833d-ad40-4370-9438-30255c921676'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:34 user nova-compute[72724]: INFO os_vif [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac')
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No VIF found with MAC fa:16:3e:28:f8:f2, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.neutron [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Updated VIF entry in instance network info cache for port c4d94ba3-ac61-4785-a904-e5342a5c1eb5. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG nova.network.neutron [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating instance_info_cache with network_info: [{"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:57:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-333ef017-a93d-4a9e-8d43-6c271686f3bb req-5222e9e6-59da-495c-8f7c-02c1392b0566 service nova] Releasing lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG nova.compute.manager [req-0e384973-ba65-42b3-970f-a642984116a4 req-5d75a6b5-2ddd-4a69-a3c0-be058a02a39b service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e384973-ba65-42b3-970f-a642984116a4 req-5d75a6b5-2ddd-4a69-a3c0-be058a02a39b service nova] Acquiring lock "6671833d-ad40-4370-9438-30255c921676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e384973-ba65-42b3-970f-a642984116a4 req-5d75a6b5-2ddd-4a69-a3c0-be058a02a39b service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0e384973-ba65-42b3-970f-a642984116a4 req-5d75a6b5-2ddd-4a69-a3c0-be058a02a39b service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:35 user nova-compute[72724]: DEBUG nova.compute.manager [req-0e384973-ba65-42b3-970f-a642984116a4 req-5d75a6b5-2ddd-4a69-a3c0-be058a02a39b service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] No waiting events found dispatching network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:57:35 user nova-compute[72724]: WARNING nova.compute.manager [req-0e384973-ba65-42b3-970f-a642984116a4 req-5d75a6b5-2ddd-4a69-a3c0-be058a02a39b service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received unexpected event network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 for instance with vm_state building and task_state spawning.
Aug 17 16:57:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:36 user nova-compute[72724]: INFO nova.compute.manager [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Attaching volume 98930e34-2674-4ffc-95ad-353ca0b32ec9 to /dev/vdb
Aug 17 16:57:36 user nova-compute[72724]: DEBUG os_brick.utils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[150d973d-82c3-478b-b0d5-5af303eaaa88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89def7c-3869-4671-bc16-ae358fded006]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd21043-ec67-4a6a-83c2-5e09deb1966a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630bb16-628d-476d-b8b0-ab15288297b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:57:36 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:57:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e2723c-fd29-47e8-abf4-ae2e9784cbe2]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG os_brick.utils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating existing volume attachment record: a8b69b00-50a1-4802-ad1c-a01181464c42 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:57:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291457.7439156, 6671833d-ad40-4370-9438-30255c921676 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] VM Resumed (Lifecycle Event)
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 6671833d-ad40-4370-9438-30255c921676] Instance spawned successfully.
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291457.7457151, 6671833d-ad40-4370-9438-30255c921676 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] VM Started (Lifecycle Event)
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 6671833d-ad40-4370-9438-30255c921676] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Took 5.59 seconds to spawn the instance on the hypervisor.
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-4830bc18-9a43-4ba7-b495-c6178e80f6df req-9f1e3a77-0fa2-4abe-b2fd-abeb1ca03e71 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4830bc18-9a43-4ba7-b495-c6178e80f6df req-9f1e3a77-0fa2-4abe-b2fd-abeb1ca03e71 service nova] Acquiring lock "6671833d-ad40-4370-9438-30255c921676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4830bc18-9a43-4ba7-b495-c6178e80f6df req-9f1e3a77-0fa2-4abe-b2fd-abeb1ca03e71 service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4830bc18-9a43-4ba7-b495-c6178e80f6df req-9f1e3a77-0fa2-4abe-b2fd-abeb1ca03e71 service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-4830bc18-9a43-4ba7-b495-c6178e80f6df req-9f1e3a77-0fa2-4abe-b2fd-abeb1ca03e71 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] No waiting events found dispatching network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:57:37 user nova-compute[72724]: WARNING nova.compute.manager [req-4830bc18-9a43-4ba7-b495-c6178e80f6df req-9f1e3a77-0fa2-4abe-b2fd-abeb1ca03e71 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received unexpected event network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 for instance with vm_state building and task_state spawning.
Aug 17 16:57:37 user nova-compute[72724]: INFO nova.compute.manager [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Took 6.15 seconds to build instance.
Aug 17 16:57:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2d912731-9543-4656-b871-7260f237c057 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.241s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:40 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291445.2056546, 8d21072e-5280-4475-8174-2cc84278cfaa => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:57:40 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Stopped (Lifecycle Event)
Aug 17 16:57:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6ae0ea68-970a-47ee-a058-6d281ea6cbf3 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:57:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-6ae0ea68-970a-47ee-a058-6d281ea6cbf3 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:57:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBhEqadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:57:47 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:57:47 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:57:47 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a16bbf-503b-465b-99f6-2cc6aa9828d9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:57:47 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba948964-7521-41a8-8079-3ea1771e9d0c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9] added
Aug 17 16:57:47 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae57e3df-b9fa-4c11-bf01-920f8d67713f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[32897d13-7cf2-4046-b3dc-99c8d246b290]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBhEqadf {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lBhEqadf" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eb39d9-5993-40d7-99d1-9bc4f723f522]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lBhEqadf'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64f0023-05f2-41a7-8862-00071e5d17ac]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1583f85e-3877-4842-9e7a-b0cd07073026]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:47 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:47 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0a7fd5-b622-4989-9a71-05ba3ab543ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260]
Aug 17 16:57:47 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260] successful.
Aug 17 16:57:47 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76abdfdc-4b0e-4d6d-868e-bc68e55933a1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb11f34-8380-46d4-b430-737ed90c4048]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:47 user nova-compute[72724]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 (non-flash)
Aug 17 16:57:47 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:47 user nova-compute[72724]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 (non-flash)
Aug 17 16:57:47 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c99235c-37e8-4c11-abb8-d1ca1b635066]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:57:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBhEqadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== connect_volume: return (1288ms) {'type': 'block', 'scsi_wwn': '23465633566363434', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465633566363434', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:57:48 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:57:48 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 16:57:48 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:57:48 user nova-compute[72724]:   <serial>98930e34-2674-4ffc-95ad-353ca0b32ec9</serial>
Aug 17 16:57:48 user nova-compute[72724]: </disk>
Aug 17 16:57:48 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:57:48 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] No VIF found with MAC fa:16:3e:78:af:2c, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:57:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e89d32d-e545-43a3-a6b6-ee6daa3d6be1 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.560s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:57:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:57:49 user nova-compute[72724]: INFO nova.compute.manager [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Detaching volume 98930e34-2674-4ffc-95ad-353ca0b32ec9
Aug 17 16:57:49 user nova-compute[72724]: INFO nova.virt.block_device [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Attempting to driver detach volume 98930e34-2674-4ffc-95ad-353ca0b32ec9 from mountpoint /dev/vdb
Aug 17 16:57:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Attempting to detach device vdb from instance cf4da440-8bdd-40c8-99d0-dc7088e76cff from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:57:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:57:49 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:57:49 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 16:57:49 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:57:49 user nova-compute[72724]:   <serial>98930e34-2674-4ffc-95ad-353ca0b32ec9</serial>
Aug 17 16:57:49 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:57:49 user nova-compute[72724]: </disk>
Aug 17 16:57:49 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:57:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully detached device vdb from instance cf4da440-8bdd-40c8-99d0-dc7088e76cff from the persistent domain config.
Aug 17 16:57:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cf4da440-8bdd-40c8-99d0-dc7088e76cff from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:57:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:57:49 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:57:49 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 16:57:49 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:57:49 user nova-compute[72724]:   <serial>98930e34-2674-4ffc-95ad-353ca0b32ec9</serial>
Aug 17 16:57:49 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 16:57:49 user nova-compute[72724]: </disk>
Aug 17 16:57:49 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291470.1516328, cf4da440-8bdd-40c8-99d0-dc7088e76cff => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:57:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully detached device vdb from instance cf4da440-8bdd-40c8-99d0-dc7088e76cff from the live domain config.
Aug 17 16:57:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lBhEqadf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:57:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f01159-3d5d-4508-bd88-2a1912eaee24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[992d47b6-a338-4aa1-8afc-6f0d0f41b81f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:50 user nova-compute[72724]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 (non-flash)
Aug 17 16:57:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:57:50 user nova-compute[72724]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 (non-flash)
Aug 17 16:57:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e024a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4adaae-e28b-4bc7-9dfb-c13ceb0b1d45]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e149a9d-8119-4eeb-b277-30426d6ef9dd]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c428885f-a6f0-47a4-8e01-3f918a0a3585]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[512997c9-925b-49c8-a820-0fd8b76e0fd1]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdca919f-86c2-4386-8644-ae0d1f1d9837]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[28685d65-e4ee-4441-b1b6-185e814bcff8]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260]
Aug 17 16:57:50 user nova-compute[72724]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9, portal: 172.16.0.220,3260] successful.
Aug 17 16:57:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98930e34-2674-4ffc-95ad-353ca0b32ec9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab185a0-e724-411d-8461-ad4ff24cc0ba]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] <== disconnect_volume: return (248ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:57:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:57:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'flavor' on Instance uuid cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:57:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-7c11de1c-486e-426e-99a8-88857b495cc3 tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.634s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:57:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:57:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:57:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:58:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating instance_info_cache with network_info: [{"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cf4da440-8bdd-40c8-99d0-dc7088e76cff" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:58:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:05 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:58:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:58:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:58:07 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:58:07 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8559MB free_disk=25.40365982055664GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cf4da440-8bdd-40c8-99d0-dc7088e76cff actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6671833d-ad40-4370-9438-30255c921676 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 16:58:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 16:58:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 16:58:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:58:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:58:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:39 user nova-compute[72724]: INFO nova.compute.manager [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Terminating instance
Aug 17 16:58:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-f866df30-9777-4995-bc51-620fd9cf93cf req-cddb28cd-fbef-4660-89e3-d18a6f1c63c0 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-vif-unplugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f866df30-9777-4995-bc51-620fd9cf93cf req-cddb28cd-fbef-4660-89e3-d18a6f1c63c0 service nova] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f866df30-9777-4995-bc51-620fd9cf93cf req-cddb28cd-fbef-4660-89e3-d18a6f1c63c0 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f866df30-9777-4995-bc51-620fd9cf93cf req-cddb28cd-fbef-4660-89e3-d18a6f1c63c0 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-f866df30-9777-4995-bc51-620fd9cf93cf req-cddb28cd-fbef-4660-89e3-d18a6f1c63c0 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] No waiting events found dispatching network-vif-unplugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-f866df30-9777-4995-bc51-620fd9cf93cf req-cddb28cd-fbef-4660-89e3-d18a6f1c63c0 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-vif-unplugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Instance destroyed successfully.
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.objects.instance [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lazy-loading 'resources' on Instance uuid cf4da440-8bdd-40c8-99d0-dc7088e76cff {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1715839882',display_name='tempest-AttachVolumeNegativeTest-server-1715839882',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1715839882',id=41,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkJBH3rtdzpyu8unrR4b6lXC2hy4Bc977me00w7Q7y83WGj1Aj531WHO0BZ6uQ/O+eQo0NQGbkO4yuUqiB+3CGhOHKqwWGT4U6FfRe5qwXtozqp/DWe7nVM7PmdaC82dA==',key_name='tempest-keypair-1703150481',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d5d8a38870654abe8b40aeb3ee406293',ramdisk_id='',reservation_id='r-z3gxt00j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1491105836',owner_user_name='tempest-AttachVolumeNegativeTest-1491105836-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d05a8d77a3b04cc783d6ef9fdea15526',uuid=cf4da440-8bdd-40c8-99d0-dc7088e76cff,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converting VIF {"id": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "address": "fa:16:3e:78:af:2c", "network": {"id": "fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1539814775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d5d8a38870654abe8b40aeb3ee406293", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc5fbd61c-12", "ovs_interfaceid": "c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG os_vif [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc5fbd61c-12, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:40 user nova-compute[72724]: INFO os_vif [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:af:2c,bridge_name='br-int',has_traffic_filtering=True,id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016,network=Network(fc12ab2e-6a81-42ca-aeaa-8e3aa0c1813c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc5fbd61c-12')
Aug 17 16:58:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Deleting instance files /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff_del
Aug 17 16:58:40 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Deletion of /opt/stack/data/nova/instances/cf4da440-8bdd-40c8-99d0-dc7088e76cff_del complete
Aug 17 16:58:40 user nova-compute[72724]: INFO nova.compute.manager [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 17 16:58:40 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 16:58:40 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:58:41 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Took 0.80 seconds to deallocate network for instance.
Aug 17 16:58:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff68d44f-df6c-40ce-ba64-fc9432587cef req-20f441e5-4e2f-44d5-a8e2-63bdf11fa01f service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-vif-deleted-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:58:41 user nova-compute[72724]: INFO nova.compute.manager [req-ff68d44f-df6c-40ce-ba64-fc9432587cef req-20f441e5-4e2f-44d5-a8e2-63bdf11fa01f service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Neutron deleted interface c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016; detaching it from the instance and deleting it from the info cache
Aug 17 16:58:41 user nova-compute[72724]: DEBUG nova.network.neutron [req-ff68d44f-df6c-40ce-ba64-fc9432587cef req-20f441e5-4e2f-44d5-a8e2-63bdf11fa01f service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff68d44f-df6c-40ce-ba64-fc9432587cef req-20f441e5-4e2f-44d5-a8e2-63bdf11fa01f service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Detach interface failed, port_id=c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016, reason: Instance cf4da440-8bdd-40c8-99d0-dc7088e76cff could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:58:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:41 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Deleted allocations for instance cf4da440-8bdd-40c8-99d0-dc7088e76cff
Aug 17 16:58:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-0290ced8-0ce2-45f4-8203-6e27cc5c592c tempest-AttachVolumeNegativeTest-1491105836 tempest-AttachVolumeNegativeTest-1491105836-project-member] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.025s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-3b9b2f89-e308-45b4-8574-c106fd542ce4 req-97f8708f-67e6-4bbe-882b-130bfa0b2ab7 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received event network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:58:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3b9b2f89-e308-45b4-8574-c106fd542ce4 req-97f8708f-67e6-4bbe-882b-130bfa0b2ab7 service nova] Acquiring lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:58:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3b9b2f89-e308-45b4-8574-c106fd542ce4 req-97f8708f-67e6-4bbe-882b-130bfa0b2ab7 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:58:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3b9b2f89-e308-45b4-8574-c106fd542ce4 req-97f8708f-67e6-4bbe-882b-130bfa0b2ab7 service nova] Lock "cf4da440-8bdd-40c8-99d0-dc7088e76cff-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:58:42 user nova-compute[72724]: DEBUG nova.compute.manager [req-3b9b2f89-e308-45b4-8574-c106fd542ce4 req-97f8708f-67e6-4bbe-882b-130bfa0b2ab7 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] No waiting events found dispatching network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:58:42 user nova-compute[72724]: WARNING nova.compute.manager [req-3b9b2f89-e308-45b4-8574-c106fd542ce4 req-97f8708f-67e6-4bbe-882b-130bfa0b2ab7 service nova] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Received unexpected event network-vif-plugged-c5fbd61c-1238-4f4a-92b6-9e9b7ab9b016 for instance with vm_state deleted and task_state None.
Aug 17 16:58:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:58:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 16:58:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 16:58:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:55 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291520.7510998, cf4da440-8bdd-40c8-99d0-dc7088e76cff => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:58:55 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] VM Stopped (Lifecycle Event)
Aug 17 16:58:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-292db66d-899c-440e-9b8a-c96cc7b5e7b1 None None] [instance: cf4da440-8bdd-40c8-99d0-dc7088e76cff] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:58:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:58:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:58:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:59:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 16:59:02 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:59:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:59:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 16:59:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:04 user nova-compute[72724]: INFO nova.compute.manager [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Unshelving
Aug 17 16:59:04 user nova-compute[72724]: INFO nova.virt.block_device [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Booting with volume 792dac02-c4a2-4135-ba9b-3779dde2952d at /dev/vda
Aug 17 16:59:04 user nova-compute[72724]: DEBUG os_brick.utils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cb2065-d441-4f46-95b0-3fe8deab1606]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e93147-2919-4197-a185-0ab28337836a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39af7fa-3828-4058-86a9-9c20306d4b8b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7abf206-1eaa-4db3-b7ca-8260cdab652e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:59:04 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:59:04 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b338344-1bb5-4de4-a1ff-0c35064f6cf2]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG os_brick.utils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:04 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating existing volume attachment record: 62f8183a-ba6f-47f2-9fa6-bae854f41978 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:59:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:59:08 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:59:08 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:59:08 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8709MB free_disk=25.430526733398438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:59:08 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6671833d-ad40-4370-9438-30255c921676 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4d85ead-e395-4cf3-b9c3-ac02da1e7236 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 16:59:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'pci_requests' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'numa_topology' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 16:59:15 user nova-compute[72724]: INFO nova.compute.claims [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Claim successful on node user
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:15 user nova-compute[72724]: INFO nova.network.neutron [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating port 68cb566f-f44c-402f-ad9b-da672fc8dc45 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:59:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance destroyed successfully.
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'resources' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec2f741-cb, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:59:15 user nova-compute[72724]: INFO os_vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb')
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:15 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[176b630b-45e4-4778-8294-cbbe0dd6fffd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcabac3-5f1f-41ab-a7e4-31a14a901d5d]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c854d750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b48e0e-9681-4a9f-bb5c-cf8aa8dd7766]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98274ef-94c9-4ec7-a4d3-56cbbfbeed41]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b7cd3b-a0c9-4520-81bf-9df62b2f6eef]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4a47d5-440a-4046-849a-df0578ce77de]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8847e55e-a400-4ad1-b51d-6839fc5aba58]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e776a239-d4df-476f-a640-77c000aeeafe]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]
Aug 17 16:59:15 user nova-compute[72724]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.
Aug 17 16:59:15 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2b7627-d4f7-425f-be41-f84f638c59e5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== disconnect_volume: return (260ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start _get_guest_xml network_info=[{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ca849199-3cbe-4b5e-b1fc-243a32a1b4b9', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8d21072e-5280-4475-8174-2cc84278cfaa', 'attached_at': '', 'detached_at': '', 'volume_id': '3604ff93-2abd-4f88-89b1-41187374e2d0', 'serial': '3604ff93-2abd-4f88-89b1-41187374e2d0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': None, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:59:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:59:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:16 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:16 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:16 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[850108fd-886d-4443-b7cd-2b1754ba6580]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:59:16 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbddc87a-94dd-4b65-99e2-3f8adc3bffe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0] added
Aug 17 16:59:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4a892f-f5e3-40ab-bf41-1842c54b6ddd]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c99d22d-4d09-49be-ab33-651cecfd005d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gULyxRAC {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gULyxRAC" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b773435c-a992-4ed9-8806-ba430993afec]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gULyxRAC'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe820b9-d9d8-4061-bc89-d493379336e7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aada2193-800d-4c9a-94da-d2297a4007cc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:59:16 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 16:59:16 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:16 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 16:59:16 user nova-compute[72724]: 
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5dc8418-39e4-4d13-8f06-715b5aa90f78]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]
Aug 17 16:59:16 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.
Aug 17 16:59:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1394b654-f31a-4514-9154-7d0925bc0a3e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a6f9b9-c7e9-433f-b4e3-fcb81fd91c23]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:16 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing instance network info cache due to event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab299e82-86ea-424c-8fdf-38fdcbd43142]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 16:59:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Creating image(s)
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Ensure instance console log exists: /opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Start _get_guest_xml network_info=[{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '62f8183a-ba6f-47f2-9fa6-bae854f41978', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c4d85ead-e395-4cf3-b9c3-ac02da1e7236', 'attached_at': '', 'detached_at': '', 'volume_id': '792dac02-c4a2-4135-ba9b-3779dde2952d', 'serial': '792dac02-c4a2-4135-ba9b-3779dde2952d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:59:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:59:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'vcpu_model' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:16 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:16 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26163653064323966', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163653064323966', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.575s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:17 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:17 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5dcd21-8252-474e-b1c4-f5e8cc0ea8de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:59:17 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:59:17 user nova-compute[72724]:   <uuid>8d21072e-5280-4475-8174-2cc84278cfaa</uuid>
Aug 17 16:59:17 user nova-compute[72724]:   <name>instance-00000027</name>
Aug 17 16:59:17 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:59:17 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:59:17 user nova-compute[72724]:   <metadata>
Aug 17 16:59:17 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:59:17 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:59:17 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeTestJSON-server-11543544</nova:name>
Aug 17 16:59:17 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:59:16</nova:creationTime>
Aug 17 16:59:17 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:59:17 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:59:17 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:59:17 user nova-compute[72724]:       <nova:owner>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:user uuid="614e07eba6ae432598427f2e4f256165">tempest-AttachVolumeTestJSON-921709659-project-member</nova:user>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:project uuid="7d7338ba99b04595b7ff8ceca1951aea">tempest-AttachVolumeTestJSON-921709659</nova:project>
Aug 17 16:59:17 user nova-compute[72724]:       </nova:owner>
Aug 17 16:59:17 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 16:59:17 user nova-compute[72724]:       <nova:ports>
Aug 17 16:59:17 user nova-compute[72724]:         <nova:port uuid="dec2f741-cbae-4a79-bf4f-86010a9c9971">
Aug 17 16:59:17 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 16:59:17 user nova-compute[72724]:         </nova:port>
Aug 17 16:59:17 user nova-compute[72724]:       </nova:ports>
Aug 17 16:59:17 user nova-compute[72724]:     </nova:instance>
Aug 17 16:59:17 user nova-compute[72724]:   </metadata>
Aug 17 16:59:17 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:59:17 user nova-compute[72724]:     <system>
Aug 17 16:59:17 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:59:17 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:59:17 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:59:17 user nova-compute[72724]:       <entry name="serial">8d21072e-5280-4475-8174-2cc84278cfaa</entry>
Aug 17 16:59:17 user nova-compute[72724]:       <entry name="uuid">8d21072e-5280-4475-8174-2cc84278cfaa</entry>
Aug 17 16:59:17 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:59:17 user nova-compute[72724]:     </system>
Aug 17 16:59:17 user nova-compute[72724]:   </sysinfo>
Aug 17 16:59:17 user nova-compute[72724]:   <os>
Aug 17 16:59:17 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:59:17 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:59:17 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:59:17 user nova-compute[72724]:   </os>
Aug 17 16:59:17 user nova-compute[72724]:   <features>
Aug 17 16:59:17 user nova-compute[72724]:     <acpi/>
Aug 17 16:59:17 user nova-compute[72724]:     <apic/>
Aug 17 16:59:17 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:59:17 user nova-compute[72724]:   </features>
Aug 17 16:59:17 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:59:17 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:59:17 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:59:17 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:59:17 user nova-compute[72724]:   </clock>
Aug 17 16:59:17 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:59:17 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:59:17 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:59:17 user nova-compute[72724]:   </cpu>
Aug 17 16:59:17 user nova-compute[72724]:   <devices>
Aug 17 16:59:17 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 16:59:17 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 16:59:17 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk"/>
Aug 17 16:59:17 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:59:17 user nova-compute[72724]:     </disk>
Aug 17 16:59:17 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:59:17 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:59:17 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 16:59:17 user nova-compute[72724]:       <target dev="vdb" bus="virtio"/>
Aug 17 16:59:17 user nova-compute[72724]:       <serial>3604ff93-2abd-4f88-89b1-41187374e2d0</serial>
Aug 17 16:59:17 user nova-compute[72724]:     </disk>
Aug 17 16:59:17 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:59:17 user nova-compute[72724]:       <mac address="fa:16:3e:c1:84:d3"/>
Aug 17 16:59:17 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:59:17 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:59:17 user nova-compute[72724]:       <target dev="tapdec2f741-cb"/>
Aug 17 16:59:17 user nova-compute[72724]:     </interface>
Aug 17 16:59:17 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:59:17 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/console.log" append="off"/>
Aug 17 16:59:17 user nova-compute[72724]:     </serial>
Aug 17 16:59:17 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:59:17 user nova-compute[72724]:     <video>
Aug 17 16:59:17 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:59:17 user nova-compute[72724]:     </video>
Aug 17 16:59:17 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:59:17 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:59:17 user nova-compute[72724]:     </rng>
Aug 17 16:59:17 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:59:17 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:59:17 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:59:17 user nova-compute[72724]:     </memballoon>
Aug 17 16:59:17 user nova-compute[72724]:   </devices>
Aug 17 16:59:17 user nova-compute[72724]: </domain>
Aug 17 16:59:17 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7fbca1-24bb-4192-b07e-c0e45cfbc4f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d] added
Aug 17 16:59:17 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aebfb70-288c-46e3-a3b9-c61a46a1a965]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad2fc1-576d-49c2-8c25-0ae9d6902028]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDROVlWN {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nDROVlWN" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[38df5f20-f6cf-4002-a5e2-1b2f1c334837]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nDROVlWN'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ef0268-c67e-4dc1-96c8-1d47cea3ce9f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d897d1-a1b9-48a9-ab86-0ec73e24bace]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:17 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:17 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updated VIF entry in instance network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0850c8b2-98cd-465a-94ab-ff1c483c0b9a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]
Aug 17 16:59:17 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.
Aug 17 16:59:17 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-74362f2a-cc16-477d-b247-3a72022804a1 req-b97e5550-9962-422f-a956-b2206fca1556 service nova] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e12eb47-ec27-4a7c-897e-e6e5d626aa93]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd65dd4-01ca-4d2d-8493-ec5751108468]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:17 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:17 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:17 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:17 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eb76b4-6dc4-4db9-8924-f252652d599e]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Cannot resize image /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'migration_context' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T16:57:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG os_vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec2f741-cb, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdec2f741-cb, col_values=(('external_ids', {'iface-id': 'dec2f741-cbae-4a79-bf4f-86010a9c9971', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:84:d3', 'vm-uuid': '8d21072e-5280-4475-8174-2cc84278cfaa'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: INFO os_vif [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb')
Aug 17 16:59:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] <== connect_volume: return (1960ms) {'type': 'block', 'scsi_wwn': '26337393235636537', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337393235636537', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-827051074',display_name='tempest-TestShelveInstance-server-827051074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-827051074',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-895857359',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7978b8f6d71449118dea5720c404771f',ramdisk_id='',reservation_id='r-zfcdeewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-13891976',owner_user_name='tempest-TestShelveInstance-13891976-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:59:04Z,user_data=None,user_id='0bf0e273cd41469598c56db22d01e858',uuid=c4d85ead-e395-4cf3-b9c3-ac02da1e7236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converting VIF {"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'pci_devices' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] End _get_guest_xml xml=<domain type="kvm">
Aug 17 16:59:18 user nova-compute[72724]:   <uuid>c4d85ead-e395-4cf3-b9c3-ac02da1e7236</uuid>
Aug 17 16:59:18 user nova-compute[72724]:   <name>instance-00000028</name>
Aug 17 16:59:18 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 16:59:18 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 16:59:18 user nova-compute[72724]:   <metadata>
Aug 17 16:59:18 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 16:59:18 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 16:59:18 user nova-compute[72724]:       <nova:name>tempest-TestShelveInstance-server-827051074</nova:name>
Aug 17 16:59:18 user nova-compute[72724]:       <nova:creationTime>2023-08-17 16:59:16</nova:creationTime>
Aug 17 16:59:18 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 16:59:18 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 16:59:18 user nova-compute[72724]:       </nova:flavor>
Aug 17 16:59:18 user nova-compute[72724]:       <nova:owner>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:user uuid="0bf0e273cd41469598c56db22d01e858">tempest-TestShelveInstance-13891976-project-member</nova:user>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:project uuid="7978b8f6d71449118dea5720c404771f">tempest-TestShelveInstance-13891976</nova:project>
Aug 17 16:59:18 user nova-compute[72724]:       </nova:owner>
Aug 17 16:59:18 user nova-compute[72724]:       <nova:ports>
Aug 17 16:59:18 user nova-compute[72724]:         <nova:port uuid="68cb566f-f44c-402f-ad9b-da672fc8dc45">
Aug 17 16:59:18 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 16:59:18 user nova-compute[72724]:         </nova:port>
Aug 17 16:59:18 user nova-compute[72724]:       </nova:ports>
Aug 17 16:59:18 user nova-compute[72724]:     </nova:instance>
Aug 17 16:59:18 user nova-compute[72724]:   </metadata>
Aug 17 16:59:18 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 16:59:18 user nova-compute[72724]:     <system>
Aug 17 16:59:18 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 16:59:18 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 16:59:18 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 16:59:18 user nova-compute[72724]:       <entry name="serial">c4d85ead-e395-4cf3-b9c3-ac02da1e7236</entry>
Aug 17 16:59:18 user nova-compute[72724]:       <entry name="uuid">c4d85ead-e395-4cf3-b9c3-ac02da1e7236</entry>
Aug 17 16:59:18 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 16:59:18 user nova-compute[72724]:     </system>
Aug 17 16:59:18 user nova-compute[72724]:   </sysinfo>
Aug 17 16:59:18 user nova-compute[72724]:   <os>
Aug 17 16:59:18 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 16:59:18 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 16:59:18 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 16:59:18 user nova-compute[72724]:   </os>
Aug 17 16:59:18 user nova-compute[72724]:   <features>
Aug 17 16:59:18 user nova-compute[72724]:     <acpi/>
Aug 17 16:59:18 user nova-compute[72724]:     <apic/>
Aug 17 16:59:18 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 16:59:18 user nova-compute[72724]:   </features>
Aug 17 16:59:18 user nova-compute[72724]:   <clock offset="utc">
Aug 17 16:59:18 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 16:59:18 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 16:59:18 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 16:59:18 user nova-compute[72724]:   </clock>
Aug 17 16:59:18 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 16:59:18 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 16:59:18 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 16:59:18 user nova-compute[72724]:   </cpu>
Aug 17 16:59:18 user nova-compute[72724]:   <devices>
Aug 17 16:59:18 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 16:59:18 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:59:18 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 16:59:18 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 16:59:18 user nova-compute[72724]:       <serial>792dac02-c4a2-4135-ba9b-3779dde2952d</serial>
Aug 17 16:59:18 user nova-compute[72724]:     </disk>
Aug 17 16:59:18 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 16:59:18 user nova-compute[72724]:       <mac address="fa:16:3e:86:51:bf"/>
Aug 17 16:59:18 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:59:18 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 16:59:18 user nova-compute[72724]:       <target dev="tap68cb566f-f4"/>
Aug 17 16:59:18 user nova-compute[72724]:     </interface>
Aug 17 16:59:18 user nova-compute[72724]:     <serial type="pty">
Aug 17 16:59:18 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236/console.log" append="off"/>
Aug 17 16:59:18 user nova-compute[72724]:     </serial>
Aug 17 16:59:18 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 16:59:18 user nova-compute[72724]:     <video>
Aug 17 16:59:18 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 16:59:18 user nova-compute[72724]:     </video>
Aug 17 16:59:18 user nova-compute[72724]:     <rng model="virtio">
Aug 17 16:59:18 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 16:59:18 user nova-compute[72724]:     </rng>
Aug 17 16:59:18 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 16:59:18 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 16:59:18 user nova-compute[72724]:       <stats period="10"/>
Aug 17 16:59:18 user nova-compute[72724]:     </memballoon>
Aug 17 16:59:18 user nova-compute[72724]:   </devices>
Aug 17 16:59:18 user nova-compute[72724]: </domain>
Aug 17 16:59:18 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-827051074',display_name='tempest-TestShelveInstance-server-827051074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-827051074',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-895857359',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7978b8f6d71449118dea5720c404771f',ramdisk_id='',reservation_id='r-zfcdeewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-13891976',owner_user_name='tempest-TestShelveInstance-13891976-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:59:04Z,user_data=None,user_id='0bf0e273cd41469598c56db22d01e858',uuid=c4d85ead-e395-4cf3-b9c3-ac02da1e7236,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converting VIF {"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG os_vif [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68cb566f-f4, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap68cb566f-f4, col_values=(('external_ids', {'iface-id': '68cb566f-f44c-402f-ad9b-da672fc8dc45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:51:bf', 'vm-uuid': 'c4d85ead-e395-4cf3-b9c3-ac02da1e7236'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:18 user nova-compute[72724]: INFO os_vif [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4')
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:59:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] No VIF found with MAC fa:16:3e:86:51:bf, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:59:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-e87168e9-c1ed-4125-9187-1ca39a9643a5 req-71b0df53-7221-4ec3-be4c-460007845c93 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e87168e9-c1ed-4125-9187-1ca39a9643a5 req-71b0df53-7221-4ec3-be4c-460007845c93 service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e87168e9-c1ed-4125-9187-1ca39a9643a5 req-71b0df53-7221-4ec3-be4c-460007845c93 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e87168e9-c1ed-4125-9187-1ca39a9643a5 req-71b0df53-7221-4ec3-be4c-460007845c93 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-e87168e9-c1ed-4125-9187-1ca39a9643a5 req-71b0df53-7221-4ec3-be4c-460007845c93 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:59:20 user nova-compute[72724]: WARNING nova.compute.manager [req-e87168e9-c1ed-4125-9187-1ca39a9643a5 req-71b0df53-7221-4ec3-be4c-460007845c93 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state stopped and task_state powering-on.
Aug 17 16:59:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:59:22 user nova-compute[72724]: WARNING nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state stopped and task_state powering-on.
Aug 17 16:59:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:59:22 user nova-compute[72724]: WARNING nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 16:59:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 16:59:22 user nova-compute[72724]: WARNING nova.compute.manager [req-93f9a911-2f7f-4b01-836d-4539a4e75500 req-79899cad-e964-4c90-8228-7fd3d9fb4a12 service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-changed-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Refreshing instance network info cache due to event network-changed-c4d94ba3-ac61-4785-a904-e5342a5c1eb5. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] Acquiring lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] Acquired lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.network.neutron [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Refreshing network info cache for port c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291563.1581476, 8d21072e-5280-4475-8174-2cc84278cfaa => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Resumed (Lifecycle Event)
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance rebooted successfully.
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-deaa521c-a8fb-4d02-aa00-132bcb6cf7d8 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291563.164664, 8d21072e-5280-4475-8174-2cc84278cfaa => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Started (Lifecycle Event)
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance spawned successfully.
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291563.2409644, c4d85ead-e395-4cf3-b9c3-ac02da1e7236 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] VM Resumed (Lifecycle Event)
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c1e80f6c-5dce-4c61-bac7-e35b46b423b4 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 18.903s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291563.242871, c4d85ead-e395-4cf3-b9c3-ac02da1e7236 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 16:59:23 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] VM Started (Lifecycle Event)
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.network.neutron [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Updated VIF entry in instance network info cache for port c4d94ba3-ac61-4785-a904-e5342a5c1eb5. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.network.neutron [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating instance_info_cache with network_info: [{"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e683067f-1b6f-41dc-aa94-e0711a877cfe req-2aac76b9-a949-48dc-84e5-fb31b03d94ec service nova] Releasing lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'flavor' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:24 user nova-compute[72724]: INFO nova.compute.manager [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attaching volume 8bdab1ad-d25c-4380-9033-814cfa987a46 to /dev/vdb
Aug 17 16:59:24 user nova-compute[72724]: DEBUG os_brick.utils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eaa0d83-03ec-4ed8-b5cb-e01dd6bda8b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7307521-d302-4f07-bdfa-85ce15ca20ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaf38ed-d69e-4f41-8cfb-be60c75133d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41a01e4-d2ad-4f0d-a2ab-489a1ac172ef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:59:24 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:59:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da70e0-ad19-4a76-a736-5ceab2723454]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG os_brick.utils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:24 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating existing volume attachment record: 2b9c820f-cf03-43b7-8db2-d2701bf8e67d {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:59:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:59:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkjopNXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:34 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fe610d-9a56-4d4a-9201-93d4b50c79a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:59:35 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a535ae-fb21-4ed9-9132-f27df13f25c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46] added
Aug 17 16:59:35 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce38ab14-fefc-4bb7-b1da-58842cf21d29]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317b5e2-c516-4b68-aea7-4be3a2fc16da]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkjopNXd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CkjopNXd" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8505a200-8280-49a3-9222-1b9a8fdbd169]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CkjopNXd'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2814e533-0713-4098-ab7b-7b579e9b14f9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[221acbf9-8413-48c1-a991-24997a231b1a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:35 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:35 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:35 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:35 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3d9f4f-a31f-439c-bbbf-521c385aaf33]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260]
Aug 17 16:59:35 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260] successful.
Aug 17 16:59:35 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[53836948-6f6c-4af0-939c-9fa8b091a394]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a306802-e29c-4046-917f-37c6bddc667a]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:35 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:35 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:35 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:35 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:35 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:35 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] HCTL ('35', '-', '-', 0) found on session 48 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f821f3-fbac-4dd1-a483-528bfaf08dcf]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Searching for a device in session 48 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:59:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkjopNXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23139643165353738', 'path': '/dev/sdd'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139643165353738', 'path': '/dev/sdd'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'flavor' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:59:36 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:59:36 user nova-compute[72724]:   <source dev="/dev/sdd"/>
Aug 17 16:59:36 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 16:59:36 user nova-compute[72724]:   <serial>8bdab1ad-d25c-4380-9033-814cfa987a46</serial>
Aug 17 16:59:36 user nova-compute[72724]: </disk>
Aug 17 16:59:36 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:59:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No VIF found with MAC fa:16:3e:28:f8:f2, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:59:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6d168dee-ea47-4ee4-9a46-09e3f15d3444 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.986s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'flavor' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:40 user nova-compute[72724]: INFO nova.compute.manager [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attaching volume 3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 to /dev/vdc
Aug 17 16:59:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d82692-cbe9-4afc-95ac-6e025a00460e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a5e29b-125a-4801-af59-baa865653bd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3e9340-e59c-4edf-b775-94c0f17300f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7205804-72ad-443e-85c5-c805165017a2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 16:59:40 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 16:59:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[148faf01-ac09-4fd7-b230-14c432c18174]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:40 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating existing volume attachment record: 45d6eddd-a389-4f5c-9162-a62ca23df2e8 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 16:59:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZxYuhrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:51 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:51 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:51 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfad999-98b3-4d2e-a63c-9dec689a4beb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 16:59:51 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef9cc49-783a-4eaf-8c2b-eaa9acd17208]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394] added
Aug 17 16:59:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[467f83d2-be2e-4fe4-9b6d-ad704534497a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2073eaa3-e70c-432f-9358-7d8cadc84793]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZxYuhrg {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nZxYuhrg" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e0096fe-5358-4429-a109-02bd4131084f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nZxYuhrg'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6253d0-8417-405d-a8c3-de21cb6146e4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb9419a-aa2d-47d6-a7e9-c7eaf39c0cf9]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2704a28d-b06d-49fa-9928-d0c16d4a028a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260]
Aug 17 16:59:51 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260] successful.
Aug 17 16:59:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd38cfc-5612-4887-b177-7131e48ae948]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e957403-dd6b-44d9-9d4c-2ea2f95c7b5c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 (non-flash)
Aug 17 16:59:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] HCTL ('36', '-', '-', 0) found on session 49 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[377c5edb-3903-44df-ad2b-cacfab0408ad]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Searching for a device in session 49 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZxYuhrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 16:59:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23831313937633666', 'path': '/dev/sde'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831313937633666', 'path': '/dev/sde'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 16:59:52 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'flavor' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 16:59:52 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:59:52 user nova-compute[72724]:   <source dev="/dev/sde"/>
Aug 17 16:59:52 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 16:59:52 user nova-compute[72724]:   <serial>3fbcabd3-e4ee-4814-8b9f-8f462ee7d394</serial>
Aug 17 16:59:52 user nova-compute[72724]: </disk>
Aug 17 16:59:52 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] No VIF found with MAC fa:16:3e:28:f8:f2, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4bc04518-f3ce-4a11-9c67-d03045ef62a4 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.836s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 8.354s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 16:59:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 16:59:54 user nova-compute[72724]: INFO nova.compute.manager [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Detaching volume 3fbcabd3-e4ee-4814-8b9f-8f462ee7d394
Aug 17 16:59:54 user nova-compute[72724]: INFO nova.virt.block_device [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attempting to driver detach volume 3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 from mountpoint /dev/vdc
Aug 17 16:59:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Attempting to detach device vdc from instance 6671833d-ad40-4370-9438-30255c921676 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 16:59:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:59:54 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:59:54 user nova-compute[72724]:   <source dev="/dev/sde"/>
Aug 17 16:59:54 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 16:59:54 user nova-compute[72724]:   <serial>3fbcabd3-e4ee-4814-8b9f-8f462ee7d394</serial>
Aug 17 16:59:54 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 16:59:54 user nova-compute[72724]: </disk>
Aug 17 16:59:54 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:59:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Successfully detached device vdc from instance 6671833d-ad40-4370-9438-30255c921676 from the persistent domain config.
Aug 17 16:59:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 6671833d-ad40-4370-9438-30255c921676 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 16:59:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 16:59:54 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 16:59:54 user nova-compute[72724]:   <source dev="/dev/sde"/>
Aug 17 16:59:54 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 16:59:54 user nova-compute[72724]:   <serial>3fbcabd3-e4ee-4814-8b9f-8f462ee7d394</serial>
Aug 17 16:59:54 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 16:59:54 user nova-compute[72724]: </disk>
Aug 17 16:59:54 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291595.404241, 6671833d-ad40-4370-9438-30255c921676 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 16:59:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Successfully detached device vdc from instance 6671833d-ad40-4370-9438-30255c921676 from the live domain config.
Aug 17 16:59:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nZxYuhrg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 16:59:55 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0302d89c-1b0d-4757-97c5-fa1120efae7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4b4dc4-973e-45d2-a467-56803b6dc640]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:55 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:55 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:55 user nova-compute[72724]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 (non-flash)
Aug 17 16:59:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 16:59:55 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 16:59:55 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 16:59:55 user nova-compute[72724]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 (non-flash)
Aug 17 16:59:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c84dbc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394'): ({'sde'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Removing single pathed devices sde {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a8913-a968-46ad-af9f-641bb26c17ab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[86347f75-f12f-4a6a-a7ba-1515fe870cc5]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Flushing IO for device /dev/sde {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5ff6a4-4ddf-498b-b768-6afb45f38b1d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be4b5bd-7abb-4c54-8e7a-3e3ffffc2e01]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] SCSI volumes sde have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a02fd5-53e0-4b38-a7ce-f60c7b5d3137]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb026043-152f-4a06-8076-70e4accbb7de]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260]
Aug 17 16:59:55 user nova-compute[72724]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394, portal: 172.16.0.220,3260] successful.
Aug 17 16:59:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fbcabd3-e4ee-4814-8b9f-8f462ee7d394 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[32409086-a787-493b-a379-2c49963d27a5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] <== disconnect_volume: return (283ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 16:59:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 16:59:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'flavor' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 16:59:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d8444a05-842d-4c83-881d-acda1ef9f770 tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.660s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 16:59:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 16:59:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 16:59:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:00:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:00:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:00:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:00:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating instance_info_cache with network_info: [{"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-6671833d-ad40-4370-9438-30255c921676" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:00:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:09 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:00:10 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:00:10 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8455MB free_disk=25.42615509033203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6671833d-ad40-4370-9438-30255c921676 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4d85ead-e395-4cf3-b9c3-ac02da1e7236 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:00:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.277s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:00:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:00:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:00:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:00:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:00:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:00:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:00:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:00:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:00:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:45 user nova-compute[72724]: INFO nova.compute.manager [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Detaching volume 8bdab1ad-d25c-4380-9033-814cfa987a46
Aug 17 17:00:45 user nova-compute[72724]: INFO nova.virt.block_device [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Attempting to driver detach volume 8bdab1ad-d25c-4380-9033-814cfa987a46 from mountpoint /dev/vdb
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Attempting to detach device vdb from instance 6671833d-ad40-4370-9438-30255c921676 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:00:45 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:00:45 user nova-compute[72724]:   <source dev="/dev/sdd"/>
Aug 17 17:00:45 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:00:45 user nova-compute[72724]:   <serial>8bdab1ad-d25c-4380-9033-814cfa987a46</serial>
Aug 17 17:00:45 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:00:45 user nova-compute[72724]: </disk>
Aug 17 17:00:45 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:00:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Successfully detached device vdb from instance 6671833d-ad40-4370-9438-30255c921676 from the persistent domain config.
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6671833d-ad40-4370-9438-30255c921676 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:00:45 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:00:45 user nova-compute[72724]:   <source dev="/dev/sdd"/>
Aug 17 17:00:45 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:00:45 user nova-compute[72724]:   <serial>8bdab1ad-d25c-4380-9033-814cfa987a46</serial>
Aug 17 17:00:45 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:00:45 user nova-compute[72724]: </disk>
Aug 17 17:00:45 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291645.921841, 6671833d-ad40-4370-9438-30255c921676 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:00:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Successfully detached device vdb from instance 6671833d-ad40-4370-9438-30255c921676 from the live domain config.
Aug 17 17:00:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CkjopNXd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:00:45 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c70ba5-bc8b-46b9-bdca-a084c7e97ba0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8921c9-5408-4034-a550-0a29eee9f072]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 17:00:45 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 17:00:45 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 17:00:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 17:00:45 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 17:00:45 user nova-compute[72724]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 (non-flash)
Aug 17 17:00:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c859ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46'): ({'sdd'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Removing single pathed devices sdd {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:00:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a26053-bb2e-4506-9df1-802d93822d08]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65c62fb-5b6e-4560-a3ae-277ffacaf280]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Flushing IO for device /dev/sdd {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b591d0-8181-49d2-9e05-c3baa7901d09]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf27bf-7215-4af3-bba8-f0f5ef178bb9]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] SCSI volumes sdd have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7221a9-2308-4911-ad42-56377775da43]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e7ac4c-8909-41e1-9ded-db7cf67d60d1]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260]
Aug 17 17:00:46 user nova-compute[72724]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46, portal: 172.16.0.220,3260] successful.
Aug 17 17:00:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bdab1ad-d25c-4380-9033-814cfa987a46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8ac584-2366-4444-81c7-c2320e2393e2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] <== disconnect_volume: return (273ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:00:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'flavor' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:00:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f9c4ba67-6f5f-49a6-950d-d1364386128b tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.648s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing instance network info cache due to event network-changed-68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] Acquiring lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] Acquired lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Refreshing network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:55 user nova-compute[72724]: INFO nova.compute.manager [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Terminating instance
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-33725dba-f654-42d1-85f7-a898993f4247 req-f257223b-34d7-4605-8af6-3047c9dc743b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-unplugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-33725dba-f654-42d1-85f7-a898993f4247 req-f257223b-34d7-4605-8af6-3047c9dc743b service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-33725dba-f654-42d1-85f7-a898993f4247 req-f257223b-34d7-4605-8af6-3047c9dc743b service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-33725dba-f654-42d1-85f7-a898993f4247 req-f257223b-34d7-4605-8af6-3047c9dc743b service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-33725dba-f654-42d1-85f7-a898993f4247 req-f257223b-34d7-4605-8af6-3047c9dc743b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-unplugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:00:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-33725dba-f654-42d1-85f7-a898993f4247 req-f257223b-34d7-4605-8af6-3047c9dc743b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-unplugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.network.neutron [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updated VIF entry in instance network info cache for port 68cb566f-f44c-402f-ad9b-da672fc8dc45. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.network.neutron [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [{"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f41eafd1-0758-423d-881c-f45661ca56a3 req-9fccb0d6-fd9f-49bc-b1d3-3259436cbfcf service nova] Releasing lock "refresh_cache-c4d85ead-e395-4cf3-b9c3-ac02da1e7236" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:00:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Instance destroyed successfully.
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lazy-loading 'resources' on Instance uuid c4d85ead-e395-4cf3-b9c3-ac02da1e7236 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-17T16:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-827051074',display_name='tempest-TestShelveInstance-server-827051074',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-827051074',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkAtFiiT01dCXwZFFS358H9yrMuYYtoc6LR3/ps5B7MHf7MQf0fGzTfPAzpfHZJLXSxbXGD/lDYizQr8VwHv4JIyo1Sgfz29Pr5e79oNgdT6MKcVRB8U8vbJeOwKNnzaA==',key_name='tempest-TestShelveInstance-895857359',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:59:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7978b8f6d71449118dea5720c404771f',ramdisk_id='',reservation_id='r-zfcdeewk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-13891976',owner_user_name='tempest-TestShelveInstance-13891976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:59:23Z,user_data=None,user_id='0bf0e273cd41469598c56db22d01e858',uuid=c4d85ead-e395-4cf3-b9c3-ac02da1e7236,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converting VIF {"id": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "address": "fa:16:3e:86:51:bf", "network": {"id": "ef5119a9-de01-462b-9a3d-f171416830e1", "bridge": "br-int", "label": "tempest-TestShelveInstance-1288084969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7978b8f6d71449118dea5720c404771f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68cb566f-f4", "ovs_interfaceid": "68cb566f-f44c-402f-ad9b-da672fc8dc45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_vif [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68cb566f-f4, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:00:56 user nova-compute[72724]: INFO os_vif [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:51:bf,bridge_name='br-int',has_traffic_filtering=True,id=68cb566f-f44c-402f-ad9b-da672fc8dc45,network=Network(ef5119a9-de01-462b-9a3d-f171416830e1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68cb566f-f4')
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nDROVlWN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:00:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[692de455-e501-49d4-888c-7c16bdf6dd57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1462eb4c-96f1-469c-9b62-25c96a9bbb8f]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 17:00:56 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 17:00:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 17:00:56 user nova-compute[72724]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d (non-flash)
Aug 17 17:00:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81bce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[43433126-6262-4330-b7e5-28d4f6dbd393]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68a81ca-8dde-4097-a5ee-5198b9a96c55]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb232e17-7ecb-4165-adea-ec5bac81392c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e443585b-d697-4316-bfa9-9f685bb1f098]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_3c6e3220', '/dev/disk/by-id/scsi-1SCST_BIO3c6e3220-c7925ce703379477', '/dev/disk/by-id/scsi-26337393235636537') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[898e536c-3308-4899-b3c2-9f7a670cd836]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec362d0-1880-4169-8d69-6dc104009d93]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0329e560-6290-4d83-85f3-5df9e99feb71]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260]
Aug 17 17:00:56 user nova-compute[72724]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d, portal: 172.16.0.220,3260] successful.
Aug 17 17:00:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:792dac02-c4a2-4135-ba9b-3779dde2952d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ade33401-f9f1-4d3f-aa0b-e67227031f0f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] <== disconnect_volume: return (293ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:00:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Deleting instance files /opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236_del
Aug 17 17:00:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Deletion of /opt/stack/data/nova/instances/c4d85ead-e395-4cf3-b9c3-ac02da1e7236_del complete
Aug 17 17:00:56 user nova-compute[72724]: INFO nova.compute.manager [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Took 1.11 seconds to destroy the instance on the hypervisor.
Aug 17 17:00:56 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:00:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:00:57 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:00:57 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Took 0.49 seconds to deallocate network for instance.
Aug 17 17:00:57 user nova-compute[72724]: INFO nova.compute.manager [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Took 0.79 seconds to detach 1 volumes for instance.
Aug 17 17:00:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:00:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] Acquiring lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] No waiting events found dispatching network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:00:57 user nova-compute[72724]: WARNING nova.compute.manager [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received unexpected event network-vif-plugged-68cb566f-f44c-402f-ad9b-da672fc8dc45 for instance with vm_state active and task_state deleting.
Aug 17 17:00:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-4ce8a0f3-5df2-4d03-b46d-caeb2a259596 req-d621ad03-ecef-42b1-96f2-d5ba3678ee6b service nova] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Received event network-vif-deleted-68cb566f-f44c-402f-ad9b-da672fc8dc45 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:00:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Deleting volume: 792dac02-c4a2-4135-ba9b-3779dde2952d {{(pid=72724) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 17:00:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:00:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:00:58 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:00:58 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:00:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.178s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:58 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Deleted allocations for instance c4d85ead-e395-4cf3-b9c3-ac02da1e7236
Aug 17 17:00:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f22cfab2-6bf6-48e4-8407-bdffe0184812 tempest-TestShelveInstance-13891976 tempest-TestShelveInstance-13891976-project-member] Lock "c4d85ead-e395-4cf3-b9c3-ac02da1e7236" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.874s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:00:59 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:01:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:01:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:01:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:01:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:01:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:01:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:01:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:06 user nova-compute[72724]: INFO nova.compute.manager [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Detaching volume 3604ff93-2abd-4f88-89b1-41187374e2d0
Aug 17 17:01:06 user nova-compute[72724]: INFO nova.virt.block_device [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Attempting to driver detach volume 3604ff93-2abd-4f88-89b1-41187374e2d0 from mountpoint /dev/vdb
Aug 17 17:01:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Attempting to detach device vdb from instance 8d21072e-5280-4475-8174-2cc84278cfaa from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:01:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:01:06 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:01:06 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:01:06 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:01:06 user nova-compute[72724]:   <serial>3604ff93-2abd-4f88-89b1-41187374e2d0</serial>
Aug 17 17:01:06 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 17:01:06 user nova-compute[72724]: </disk>
Aug 17 17:01:06 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:01:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully detached device vdb from instance 8d21072e-5280-4475-8174-2cc84278cfaa from the persistent domain config.
Aug 17 17:01:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8d21072e-5280-4475-8174-2cc84278cfaa from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:01:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:01:06 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:01:06 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:01:06 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:01:06 user nova-compute[72724]:   <serial>3604ff93-2abd-4f88-89b1-41187374e2d0</serial>
Aug 17 17:01:06 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 17 17:01:06 user nova-compute[72724]: </disk>
Aug 17 17:01:06 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:01:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291667.0826752, 8d21072e-5280-4475-8174-2cc84278cfaa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:01:07 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully detached device vdb from instance 8d21072e-5280-4475-8174-2cc84278cfaa from the live domain config.
Aug 17 17:01:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gULyxRAC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:01:07 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bceed1c6-676b-4767-bc3c-06dc0458ded9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8f824b-aa9e-4f86-b71b-b7dae23c318c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 17:01:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 (non-flash)
Aug 17 17:01:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c859bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8efea1-7104-41e5-8c01-4600005668e1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cec48ea-e49f-4d12-aac4-9bdec4b037a2]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13adde1e-f640-41ad-8c7d-8cfe9f6bc26b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe223614-7955-4a86-a437-6845f82aa1c7]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64e2e8a-7170-4a8a-aa11-9b4911afcd7c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b970a8a-569f-473f-bff6-45c574ba3b68]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260]
Aug 17 17:01:07 user nova-compute[72724]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0, portal: 172.16.0.220,3260] successful.
Aug 17 17:01:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3604ff93-2abd-4f88-89b1-41187374e2d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d7d92c-c2c0-44d6-9437-03dabe65f1a6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.260s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== disconnect_volume: return (261ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:01:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1c63de77-7050-487c-aa2a-0625d48235b6 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.623s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72724) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-16a89bea-8abf-47dd-8d90-72644969192c req-e00cfb5b-5129-45ae-b400-05908dca73e2 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-16a89bea-8abf-47dd-8d90-72644969192c req-e00cfb5b-5129-45ae-b400-05908dca73e2 service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-16a89bea-8abf-47dd-8d90-72644969192c req-e00cfb5b-5129-45ae-b400-05908dca73e2 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-16a89bea-8abf-47dd-8d90-72644969192c req-e00cfb5b-5129-45ae-b400-05908dca73e2 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-16a89bea-8abf-47dd-8d90-72644969192c req-e00cfb5b-5129-45ae-b400-05908dca73e2 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:01:09 user nova-compute[72724]: WARNING nova.compute.manager [req-16a89bea-8abf-47dd-8d90-72644969192c req-e00cfb5b-5129-45ae-b400-05908dca73e2 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state active and task_state powering-off.
Aug 17 17:01:09 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance destroyed successfully.
Aug 17 17:01:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-54021f5a-f3e6-4bc2-b128-c196f7637664 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.870s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:01:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:01:11 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:01:11 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8684MB free_disk=25.415847778320312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 6671833d-ad40-4370-9438-30255c921676 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291656.2802136, c4d85ead-e395-4cf3-b9c3-ac02da1e7236 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:01:11 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] VM Stopped (Lifecycle Event)
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-b758033b-80aa-475b-a36e-bfa833e69c35 req-f0b344d6-b639-4132-8406-f27db9c54449 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b758033b-80aa-475b-a36e-bfa833e69c35 req-f0b344d6-b639-4132-8406-f27db9c54449 service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b758033b-80aa-475b-a36e-bfa833e69c35 req-f0b344d6-b639-4132-8406-f27db9c54449 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b758033b-80aa-475b-a36e-bfa833e69c35 req-f0b344d6-b639-4132-8406-f27db9c54449 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.manager [req-b758033b-80aa-475b-a36e-bfa833e69c35 req-f0b344d6-b639-4132-8406-f27db9c54449 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:01:11 user nova-compute[72724]: WARNING nova.compute.manager [req-b758033b-80aa-475b-a36e-bfa833e69c35 req-f0b344d6-b639-4132-8406-f27db9c54449 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state stopped and task_state None.
Aug 17 17:01:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ee6dfdc7-a9cc-46eb-ab3c-186cc23d14d4 None None] [instance: c4d85ead-e395-4cf3-b9c3-ac02da1e7236] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:01:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:01:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:01:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:01:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:01:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:24 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291669.6409085, 8d21072e-5280-4475-8174-2cc84278cfaa => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:01:24 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Stopped (Lifecycle Event)
Aug 17 17:01:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b25b912a-0240-4adf-8268-46a042183061 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:01:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b25b912a-0240-4adf-8268-46a042183061 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:01:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:01:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "6671833d-ad40-4370-9438-30255c921676-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:35 user nova-compute[72724]: INFO nova.compute.manager [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Terminating instance
Aug 17 17:01:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ab0a5857-e4fc-42b3-9b55-3da940fc9b0e req-ebb1dff5-69b1-4bf8-a1f1-68b455b5eb8b service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-vif-unplugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ab0a5857-e4fc-42b3-9b55-3da940fc9b0e req-ebb1dff5-69b1-4bf8-a1f1-68b455b5eb8b service nova] Acquiring lock "6671833d-ad40-4370-9438-30255c921676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ab0a5857-e4fc-42b3-9b55-3da940fc9b0e req-ebb1dff5-69b1-4bf8-a1f1-68b455b5eb8b service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ab0a5857-e4fc-42b3-9b55-3da940fc9b0e req-ebb1dff5-69b1-4bf8-a1f1-68b455b5eb8b service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ab0a5857-e4fc-42b3-9b55-3da940fc9b0e req-ebb1dff5-69b1-4bf8-a1f1-68b455b5eb8b service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] No waiting events found dispatching network-vif-unplugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-ab0a5857-e4fc-42b3-9b55-3da940fc9b0e req-ebb1dff5-69b1-4bf8-a1f1-68b455b5eb8b service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-vif-unplugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 6671833d-ad40-4370-9438-30255c921676] Instance destroyed successfully.
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lazy-loading 'resources' on Instance uuid 6671833d-ad40-4370-9438-30255c921676 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:57:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1920291466',display_name='tempest-TestServerVolumeAttachmentScenario-server-1920291466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1920291466',id=42,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIoq3wJx/bq/KVU2ylcC/PbSks06k1+lti2aBN+WOitto25NqFd5WZaw+iHPr1mfyssKsoiV5T7PC8bcwC66PqfBl2Qj6NXrVa6EIjTj2F97L+flElvaKR1tLdX9WJFmiA==',key_name='tempest-keypair-1046459166',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:57:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='566f2f793b834961a0ce8244e635e5df',ramdisk_id='',reservation_id='r-frud9cuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-758837737',owner_user_name='tempest-TestServerVolumeAttachmentScenario-758837737-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T16:57:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9a006d33d2494c2fa8ac09b08721ee25',uuid=6671833d-ad40-4370-9438-30255c921676,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Converting VIF {"id": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "address": "fa:16:3e:28:f8:f2", "network": {"id": "cdf27944-161c-4ff9-9cd2-5722918541f1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-485672587-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "566f2f793b834961a0ce8244e635e5df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4d94ba3-ac", "ovs_interfaceid": "c4d94ba3-ac61-4785-a904-e5342a5c1eb5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG os_vif [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4d94ba3-ac, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:36 user nova-compute[72724]: INFO os_vif [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:f8:f2,bridge_name='br-int',has_traffic_filtering=True,id=c4d94ba3-ac61-4785-a904-e5342a5c1eb5,network=Network(cdf27944-161c-4ff9-9cd2-5722918541f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4d94ba3-ac')
Aug 17 17:01:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Deleting instance files /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676_del
Aug 17 17:01:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Deletion of /opt/stack/data/nova/instances/6671833d-ad40-4370-9438-30255c921676_del complete
Aug 17 17:01:36 user nova-compute[72724]: INFO nova.compute.manager [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] [instance: 6671833d-ad40-4370-9438-30255c921676] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 17:01:36 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 6671833d-ad40-4370-9438-30255c921676] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:01:36 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 6671833d-ad40-4370-9438-30255c921676] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-753150c6-a726-4c69-a78c-f15c8feec1f7 req-161f2967-a969-4021-9420-f51797b4b6f4 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-753150c6-a726-4c69-a78c-f15c8feec1f7 req-161f2967-a969-4021-9420-f51797b4b6f4 service nova] Acquiring lock "6671833d-ad40-4370-9438-30255c921676-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-753150c6-a726-4c69-a78c-f15c8feec1f7 req-161f2967-a969-4021-9420-f51797b4b6f4 service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-753150c6-a726-4c69-a78c-f15c8feec1f7 req-161f2967-a969-4021-9420-f51797b4b6f4 service nova] Lock "6671833d-ad40-4370-9438-30255c921676-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-753150c6-a726-4c69-a78c-f15c8feec1f7 req-161f2967-a969-4021-9420-f51797b4b6f4 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] No waiting events found dispatching network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:01:38 user nova-compute[72724]: WARNING nova.compute.manager [req-753150c6-a726-4c69-a78c-f15c8feec1f7 req-161f2967-a969-4021-9420-f51797b4b6f4 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received unexpected event network-vif-plugged-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 for instance with vm_state active and task_state deleting.
Aug 17 17:01:38 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 6671833d-ad40-4370-9438-30255c921676] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:01:38 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 6671833d-ad40-4370-9438-30255c921676] Took 1.53 seconds to deallocate network for instance.
Aug 17 17:01:38 user nova-compute[72724]: DEBUG nova.compute.manager [req-df255ce1-3e34-4a00-8e1c-bc07b7b00e4b req-e8c5e8e3-eebb-4b1c-a741-fa0ca328eb05 service nova] [instance: 6671833d-ad40-4370-9438-30255c921676] Received event network-vif-deleted-c4d94ba3-ac61-4785-a904-e5342a5c1eb5 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:38 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Deleted allocations for instance 6671833d-ad40-4370-9438-30255c921676
Aug 17 17:01:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5c715c0e-e9d1-4c96-a0a9-38d28603897f tempest-TestServerVolumeAttachmentScenario-758837737 tempest-TestServerVolumeAttachmentScenario-758837737-project-member] Lock "6671833d-ad40-4370-9438-30255c921676" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.129s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:01:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:51 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291696.5217915, 6671833d-ad40-4370-9438-30255c921676 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:01:51 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 6671833d-ad40-4370-9438-30255c921676] VM Stopped (Lifecycle Event)
Aug 17 17:01:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ab70e383-370f-4dbc-9eda-a81ef605289c None None] [instance: 6671833d-ad40-4370-9438-30255c921676] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:01:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:01:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:01 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:04 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:02:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:02:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:02:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:02:09 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:02:10 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:02:10 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.441417694091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:02:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:02:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:02:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:02:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:02:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:02:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:02:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:02:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:02:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:02:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:54 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:02:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:02:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:02:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:02:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:02:59 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:02:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:03:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance destroyed successfully.
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'resources' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG os_vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec2f741-cb, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:03:00 user nova-compute[72724]: INFO os_vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb')
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start _get_guest_xml network_info=[{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:00 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:03:00 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:03:00 user nova-compute[72724]:   <uuid>8d21072e-5280-4475-8174-2cc84278cfaa</uuid>
Aug 17 17:03:00 user nova-compute[72724]:   <name>instance-00000027</name>
Aug 17 17:03:00 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:03:00 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:03:00 user nova-compute[72724]:   <metadata>
Aug 17 17:03:00 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:03:00 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:03:00 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeTestJSON-server-11543544</nova:name>
Aug 17 17:03:00 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:03:00</nova:creationTime>
Aug 17 17:03:00 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:03:00 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:03:00 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:03:00 user nova-compute[72724]:       <nova:owner>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:user uuid="614e07eba6ae432598427f2e4f256165">tempest-AttachVolumeTestJSON-921709659-project-member</nova:user>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:project uuid="7d7338ba99b04595b7ff8ceca1951aea">tempest-AttachVolumeTestJSON-921709659</nova:project>
Aug 17 17:03:00 user nova-compute[72724]:       </nova:owner>
Aug 17 17:03:00 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 17:03:00 user nova-compute[72724]:       <nova:ports>
Aug 17 17:03:00 user nova-compute[72724]:         <nova:port uuid="dec2f741-cbae-4a79-bf4f-86010a9c9971">
Aug 17 17:03:00 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 17:03:00 user nova-compute[72724]:         </nova:port>
Aug 17 17:03:00 user nova-compute[72724]:       </nova:ports>
Aug 17 17:03:00 user nova-compute[72724]:     </nova:instance>
Aug 17 17:03:00 user nova-compute[72724]:   </metadata>
Aug 17 17:03:00 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:03:00 user nova-compute[72724]:     <system>
Aug 17 17:03:00 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:03:00 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:03:00 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:03:00 user nova-compute[72724]:       <entry name="serial">8d21072e-5280-4475-8174-2cc84278cfaa</entry>
Aug 17 17:03:00 user nova-compute[72724]:       <entry name="uuid">8d21072e-5280-4475-8174-2cc84278cfaa</entry>
Aug 17 17:03:00 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:03:00 user nova-compute[72724]:     </system>
Aug 17 17:03:00 user nova-compute[72724]:   </sysinfo>
Aug 17 17:03:00 user nova-compute[72724]:   <os>
Aug 17 17:03:00 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:03:00 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:03:00 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:03:00 user nova-compute[72724]:   </os>
Aug 17 17:03:00 user nova-compute[72724]:   <features>
Aug 17 17:03:00 user nova-compute[72724]:     <acpi/>
Aug 17 17:03:00 user nova-compute[72724]:     <apic/>
Aug 17 17:03:00 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:03:00 user nova-compute[72724]:   </features>
Aug 17 17:03:00 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:03:00 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:03:00 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:03:00 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:03:00 user nova-compute[72724]:   </clock>
Aug 17 17:03:00 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:03:00 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:03:00 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:03:00 user nova-compute[72724]:   </cpu>
Aug 17 17:03:00 user nova-compute[72724]:   <devices>
Aug 17 17:03:00 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 17:03:00 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 17:03:00 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk"/>
Aug 17 17:03:00 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:03:00 user nova-compute[72724]:     </disk>
Aug 17 17:03:00 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:03:00 user nova-compute[72724]:       <mac address="fa:16:3e:c1:84:d3"/>
Aug 17 17:03:00 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:03:00 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:03:00 user nova-compute[72724]:       <target dev="tapdec2f741-cb"/>
Aug 17 17:03:00 user nova-compute[72724]:     </interface>
Aug 17 17:03:00 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:03:00 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/console.log" append="off"/>
Aug 17 17:03:00 user nova-compute[72724]:     </serial>
Aug 17 17:03:00 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:03:00 user nova-compute[72724]:     <video>
Aug 17 17:03:00 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:03:00 user nova-compute[72724]:     </video>
Aug 17 17:03:00 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:03:00 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:03:00 user nova-compute[72724]:     </rng>
Aug 17 17:03:00 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:03:00 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:03:00 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:03:00 user nova-compute[72724]:     </memballoon>
Aug 17 17:03:00 user nova-compute[72724]:   </devices>
Aug 17 17:03:00 user nova-compute[72724]: </domain>
Aug 17 17:03:00 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:03:00 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Cannot resize image /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'migration_context' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:01:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG os_vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdec2f741-cb, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdec2f741-cb, col_values=(('external_ids', {'iface-id': 'dec2f741-cbae-4a79-bf4f-86010a9c9971', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:84:d3', 'vm-uuid': '8d21072e-5280-4475-8174-2cc84278cfaa'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:01 user nova-compute[72724]: INFO os_vif [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb')
Aug 17 17:03:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-e943874c-0552-4d2b-b628-54a15f9e7dce req-4c56f83e-d030-4aef-9311-44762c44561c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e943874c-0552-4d2b-b628-54a15f9e7dce req-4c56f83e-d030-4aef-9311-44762c44561c service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e943874c-0552-4d2b-b628-54a15f9e7dce req-4c56f83e-d030-4aef-9311-44762c44561c service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e943874c-0552-4d2b-b628-54a15f9e7dce req-4c56f83e-d030-4aef-9311-44762c44561c service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-e943874c-0552-4d2b-b628-54a15f9e7dce req-4c56f83e-d030-4aef-9311-44762c44561c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:03:03 user nova-compute[72724]: WARNING nova.compute.manager [req-e943874c-0552-4d2b-b628-54a15f9e7dce req-4c56f83e-d030-4aef-9311-44762c44561c service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state stopped and task_state powering-on.
Aug 17 17:03:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:03 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:03:04 user nova-compute[72724]: INFO nova.compute.claims [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Claim successful on node user
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.network.neutron [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:03:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:03:04 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Creating image(s)
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "/opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "/opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "/opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:04 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.policy [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '020bea0e49c240dc81da4a3a9a05fe12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3b5e6a29fa4a889f7e14003ed3a453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291785.1504803, 8d21072e-5280-4475-8174-2cc84278cfaa => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:03:05 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Resumed (Lifecycle Event)
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:03:05 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance rebooted successfully.
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d6d3b58f-d961-419e-8704-06bfddadf2b7 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:03:05 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291785.155568, 8d21072e-5280-4475-8174-2cc84278cfaa => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:03:05 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Started (Lifecycle Event)
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.187s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk 1073741824" returned: 0 in 0.059s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff48481c-867b-4f79-881e-7bc470cc955f req-e6e41a32-c96f-4f7b-805d-26f6011c287f service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff48481c-867b-4f79-881e-7bc470cc955f req-e6e41a32-c96f-4f7b-805d-26f6011c287f service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff48481c-867b-4f79-881e-7bc470cc955f req-e6e41a32-c96f-4f7b-805d-26f6011c287f service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ff48481c-867b-4f79-881e-7bc470cc955f req-e6e41a32-c96f-4f7b-805d-26f6011c287f service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-ff48481c-867b-4f79-881e-7bc470cc955f req-e6e41a32-c96f-4f7b-805d-26f6011c287f service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:03:05 user nova-compute[72724]: WARNING nova.compute.manager [req-ff48481c-867b-4f79-881e-7bc470cc955f req-e6e41a32-c96f-4f7b-805d-26f6011c287f service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state active and task_state None.
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.network.neutron [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Successfully created port: 33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Cannot resize image /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.objects.instance [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'migration_context' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Ensure instance console log exists: /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Successfully updated port: 33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:06 user nova-compute[72724]: DEBUG nova.network.neutron [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Instance network_info: |[{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Start _get_guest_xml network_info=[{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:03:07 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:03:07 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1475085965',display_name='tempest-TestStampPattern-server-1475085965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1475085965',id=43,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXYKcFPVGOL27nygfwan9oKUSyPDhwCmmd9xaTXKo6Oy+FXvrn7pGndZRwFepyZ++VdvRLoFLRME2rOGBGwWO9muZKyZr9tL1cDRihzIsoTmp0UWvUV5c2HXvZei+4eIg==',key_name='tempest-TestStampPattern-221982094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec3b5e6a29fa4a889f7e14003ed3a453',ramdisk_id='',reservation_id='r-l3t7bv7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-249761649',owner_user_name='tempest-TestStampPattern-249761649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:03:05Z,user_data=None,user_id='020bea0e49c240dc81da4a3a9a05fe12',uuid=f116cdf6-59ef-48fd-850e-8cb5e206ecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converting VIF {"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.objects.instance [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'pci_devices' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:03:07 user nova-compute[72724]:   <uuid>f116cdf6-59ef-48fd-850e-8cb5e206ecc0</uuid>
Aug 17 17:03:07 user nova-compute[72724]:   <name>instance-0000002b</name>
Aug 17 17:03:07 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:03:07 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:03:07 user nova-compute[72724]:   <metadata>
Aug 17 17:03:07 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:03:07 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:03:07 user nova-compute[72724]:       <nova:name>tempest-TestStampPattern-server-1475085965</nova:name>
Aug 17 17:03:07 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:03:07</nova:creationTime>
Aug 17 17:03:07 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:03:07 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:03:07 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:03:07 user nova-compute[72724]:       <nova:owner>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:user uuid="020bea0e49c240dc81da4a3a9a05fe12">tempest-TestStampPattern-249761649-project-member</nova:user>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:project uuid="ec3b5e6a29fa4a889f7e14003ed3a453">tempest-TestStampPattern-249761649</nova:project>
Aug 17 17:03:07 user nova-compute[72724]:       </nova:owner>
Aug 17 17:03:07 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 17:03:07 user nova-compute[72724]:       <nova:ports>
Aug 17 17:03:07 user nova-compute[72724]:         <nova:port uuid="33340ff4-9784-4089-ae55-33222223e2dd">
Aug 17 17:03:07 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 17:03:07 user nova-compute[72724]:         </nova:port>
Aug 17 17:03:07 user nova-compute[72724]:       </nova:ports>
Aug 17 17:03:07 user nova-compute[72724]:     </nova:instance>
Aug 17 17:03:07 user nova-compute[72724]:   </metadata>
Aug 17 17:03:07 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:03:07 user nova-compute[72724]:     <system>
Aug 17 17:03:07 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:03:07 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:03:07 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:03:07 user nova-compute[72724]:       <entry name="serial">f116cdf6-59ef-48fd-850e-8cb5e206ecc0</entry>
Aug 17 17:03:07 user nova-compute[72724]:       <entry name="uuid">f116cdf6-59ef-48fd-850e-8cb5e206ecc0</entry>
Aug 17 17:03:07 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:03:07 user nova-compute[72724]:     </system>
Aug 17 17:03:07 user nova-compute[72724]:   </sysinfo>
Aug 17 17:03:07 user nova-compute[72724]:   <os>
Aug 17 17:03:07 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:03:07 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:03:07 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:03:07 user nova-compute[72724]:   </os>
Aug 17 17:03:07 user nova-compute[72724]:   <features>
Aug 17 17:03:07 user nova-compute[72724]:     <acpi/>
Aug 17 17:03:07 user nova-compute[72724]:     <apic/>
Aug 17 17:03:07 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:03:07 user nova-compute[72724]:   </features>
Aug 17 17:03:07 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:03:07 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:03:07 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:03:07 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:03:07 user nova-compute[72724]:   </clock>
Aug 17 17:03:07 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:03:07 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:03:07 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:03:07 user nova-compute[72724]:   </cpu>
Aug 17 17:03:07 user nova-compute[72724]:   <devices>
Aug 17 17:03:07 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 17:03:07 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 17:03:07 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk"/>
Aug 17 17:03:07 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:03:07 user nova-compute[72724]:     </disk>
Aug 17 17:03:07 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:03:07 user nova-compute[72724]:       <mac address="fa:16:3e:a9:16:1f"/>
Aug 17 17:03:07 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:03:07 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:03:07 user nova-compute[72724]:       <target dev="tap33340ff4-97"/>
Aug 17 17:03:07 user nova-compute[72724]:     </interface>
Aug 17 17:03:07 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:03:07 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/console.log" append="off"/>
Aug 17 17:03:07 user nova-compute[72724]:     </serial>
Aug 17 17:03:07 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:03:07 user nova-compute[72724]:     <video>
Aug 17 17:03:07 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:03:07 user nova-compute[72724]:     </video>
Aug 17 17:03:07 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:03:07 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:03:07 user nova-compute[72724]:     </rng>
Aug 17 17:03:07 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:03:07 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:03:07 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:03:07 user nova-compute[72724]:     </memballoon>
Aug 17 17:03:07 user nova-compute[72724]:   </devices>
Aug 17 17:03:07 user nova-compute[72724]: </domain>
Aug 17 17:03:07 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1475085965',display_name='tempest-TestStampPattern-server-1475085965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1475085965',id=43,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXYKcFPVGOL27nygfwan9oKUSyPDhwCmmd9xaTXKo6Oy+FXvrn7pGndZRwFepyZ++VdvRLoFLRME2rOGBGwWO9muZKyZr9tL1cDRihzIsoTmp0UWvUV5c2HXvZei+4eIg==',key_name='tempest-TestStampPattern-221982094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec3b5e6a29fa4a889f7e14003ed3a453',ramdisk_id='',reservation_id='r-l3t7bv7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-249761649',owner_user_name='tempest-TestStampPattern-249761649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:03:05Z,user_data=None,user_id='020bea0e49c240dc81da4a3a9a05fe12',uuid=f116cdf6-59ef-48fd-850e-8cb5e206ecc0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converting VIF {"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG os_vif [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33340ff4-97, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33340ff4-97, col_values=(('external_ids', {'iface-id': '33340ff4-9784-4089-ae55-33222223e2dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:16:1f', 'vm-uuid': 'f116cdf6-59ef-48fd-850e-8cb5e206ecc0'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:07 user nova-compute[72724]: INFO os_vif [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97')
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No VIF found with MAC fa:16:3e:a9:16:1f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-changed-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.compute.manager [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Refreshing instance network info cache due to event network-changed-33340ff4-9784-4089-ae55-33222223e2dd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.network.neutron [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Refreshing network info cache for port 33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Skipping network cache update for instance because it is Building. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:03:07 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated VIF entry in instance network info cache for port 33340ff4-9784-4089-ae55-33222223e2dd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e9f2b80e-7bc0-4214-87fc-1d491a69d9ea req-2448cec0-2abe-49cd-b3e5-5f7f78455611 service nova] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-5c16dc30-91e4-48cb-930f-9051841788ad req-0219c246-109a-44ba-a2be-0a3f00977834 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c16dc30-91e4-48cb-930f-9051841788ad req-0219c246-109a-44ba-a2be-0a3f00977834 service nova] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c16dc30-91e4-48cb-930f-9051841788ad req-0219c246-109a-44ba-a2be-0a3f00977834 service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5c16dc30-91e4-48cb-930f-9051841788ad req-0219c246-109a-44ba-a2be-0a3f00977834 service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-5c16dc30-91e4-48cb-930f-9051841788ad req-0219c246-109a-44ba-a2be-0a3f00977834 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] No waiting events found dispatching network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:03:08 user nova-compute[72724]: WARNING nova.compute.manager [req-5c16dc30-91e4-48cb-930f-9051841788ad req-0219c246-109a-44ba-a2be-0a3f00977834 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received unexpected event network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd for instance with vm_state building and task_state spawning.
Aug 17 17:03:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291790.5775838, f116cdf6-59ef-48fd-850e-8cb5e206ecc0 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] VM Resumed (Lifecycle Event)
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Instance spawned successfully.
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291790.5812185, f116cdf6-59ef-48fd-850e-8cb5e206ecc0 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] VM Started (Lifecycle Event)
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Took 5.77 seconds to spawn the instance on the hypervisor.
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:03:10 user nova-compute[72724]: INFO nova.compute.manager [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Took 6.37 seconds to build instance.
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-1f7d6c88-0acd-4496-8b75-c77809253ac3 req-5be9c21c-622b-4bb9-bea6-412fe4af03ed service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1f7d6c88-0acd-4496-8b75-c77809253ac3 req-5be9c21c-622b-4bb9-bea6-412fe4af03ed service nova] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1f7d6c88-0acd-4496-8b75-c77809253ac3 req-5be9c21c-622b-4bb9-bea6-412fe4af03ed service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1f7d6c88-0acd-4496-8b75-c77809253ac3 req-5be9c21c-622b-4bb9-bea6-412fe4af03ed service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-1f7d6c88-0acd-4496-8b75-c77809253ac3 req-5be9c21c-622b-4bb9-bea6-412fe4af03ed service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] No waiting events found dispatching network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:03:10 user nova-compute[72724]: WARNING nova.compute.manager [req-1f7d6c88-0acd-4496-8b75-c77809253ac3 req-5be9c21c-622b-4bb9-bea6-412fe4af03ed service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received unexpected event network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd for instance with vm_state active and task_state None.
Aug 17 17:03:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-48d42ac2-4dee-42cd-8dac-2732f80ec0bc tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.529s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:03:12 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:03:12 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:03:12 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.436859130859375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:03:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:03:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:03:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:03:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:03:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:03:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:03:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:03:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:03:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:03:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:03:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:03:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:03:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:02 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:04:07 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:04:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [{"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:04:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-8d21072e-5280-4475-8174-2cc84278cfaa" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:04:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:04:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:04:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:12 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:04:12 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:04:12 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8695MB free_disk=25.400455474853516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8d21072e-5280-4475-8174-2cc84278cfaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:04:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:04:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:04:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:04:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:04:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:50 user nova-compute[72724]: INFO nova.compute.manager [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Terminating instance
Aug 17 17:04:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-5971277b-6df2-4b90-a5ba-ee9984031503 req-f8f244a9-0cff-4e1c-a018-ba923ae8d4d6 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5971277b-6df2-4b90-a5ba-ee9984031503 req-f8f244a9-0cff-4e1c-a018-ba923ae8d4d6 service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5971277b-6df2-4b90-a5ba-ee9984031503 req-f8f244a9-0cff-4e1c-a018-ba923ae8d4d6 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5971277b-6df2-4b90-a5ba-ee9984031503 req-f8f244a9-0cff-4e1c-a018-ba923ae8d4d6 service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-5971277b-6df2-4b90-a5ba-ee9984031503 req-f8f244a9-0cff-4e1c-a018-ba923ae8d4d6 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-5971277b-6df2-4b90-a5ba-ee9984031503 req-f8f244a9-0cff-4e1c-a018-ba923ae8d4d6 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-unplugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Instance destroyed successfully.
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'resources' on Instance uuid 8d21072e-5280-4475-8174-2cc84278cfaa {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T16:55:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-11543544',display_name='tempest-AttachVolumeTestJSON-server-11543544',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-11543544',id=39,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPEwmy7rgj/asX/scNTzk7AcHbZDzdk3iUpvNDzDlW/7AEQ008+N1yuMlQzebJlsqIZOmumDmg8/xZBfjj0hiC5a7ibtrkOiEK7IY2FuRaN/b9h9cF7VsRBxQm5yYJERqw==',key_name='tempest-keypair-1974126831',keypairs=<?>,launch_index=0,launched_at=2023-08-17T16:55:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-r4v39qqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:03:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=8d21072e-5280-4475-8174-2cc84278cfaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "address": "fa:16:3e:c1:84:d3", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.170", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdec2f741-cb", "ovs_interfaceid": "dec2f741-cbae-4a79-bf4f-86010a9c9971", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG os_vif [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdec2f741-cb, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:04:51 user nova-compute[72724]: INFO os_vif [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:84:d3,bridge_name='br-int',has_traffic_filtering=True,id=dec2f741-cbae-4a79-bf4f-86010a9c9971,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdec2f741-cb')
Aug 17 17:04:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Deleting instance files /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa_del
Aug 17 17:04:51 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Deletion of /opt/stack/data/nova/instances/8d21072e-5280-4475-8174-2cc84278cfaa_del complete
Aug 17 17:04:51 user nova-compute[72724]: INFO nova.compute.manager [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 17:04:51 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:04:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:52 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:04:52 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Took 0.77 seconds to deallocate network for instance.
Aug 17 17:04:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:52 user nova-compute[72724]: DEBUG nova.compute.manager [req-7899ffe4-7257-4d32-866f-ff216e9ef217 req-031c60d2-6988-4083-ae71-2945fa8671a0 service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-deleted-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:04:52 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:04:52 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:04:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:52 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Deleted allocations for instance 8d21072e-5280-4475-8174-2cc84278cfaa
Aug 17 17:04:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-75debea6-664b-44c5-b8bb-154b9295f4ee tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "8d21072e-5280-4475-8174-2cc84278cfaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.992s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-0f7c3870-c5b2-446d-b971-68e644475235 req-c8dd5aff-3964-4931-ad93-8ea710ad22ba service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:04:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0f7c3870-c5b2-446d-b971-68e644475235 req-c8dd5aff-3964-4931-ad93-8ea710ad22ba service nova] Acquiring lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0f7c3870-c5b2-446d-b971-68e644475235 req-c8dd5aff-3964-4931-ad93-8ea710ad22ba service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0f7c3870-c5b2-446d-b971-68e644475235 req-c8dd5aff-3964-4931-ad93-8ea710ad22ba service nova] Lock "8d21072e-5280-4475-8174-2cc84278cfaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-0f7c3870-c5b2-446d-b971-68e644475235 req-c8dd5aff-3964-4931-ad93-8ea710ad22ba service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] No waiting events found dispatching network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:04:53 user nova-compute[72724]: WARNING nova.compute.manager [req-0f7c3870-c5b2-446d-b971-68e644475235 req-c8dd5aff-3964-4931-ad93-8ea710ad22ba service nova] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Received unexpected event network-vif-plugged-dec2f741-cbae-4a79-bf4f-86010a9c9971 for instance with vm_state deleted and task_state None.
Aug 17 17:04:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-changed-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:04:55 user nova-compute[72724]: DEBUG nova.compute.manager [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Refreshing instance network info cache due to event network-changed-33340ff4-9784-4089-ae55-33222223e2dd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:04:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:04:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:04:55 user nova-compute[72724]: DEBUG nova.network.neutron [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Refreshing network info cache for port 33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'flavor' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:04:56 user nova-compute[72724]: INFO nova.compute.manager [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Attaching volume b48199c6-f7f4-4372-a0c9-81601cfc253d to /dev/vdb
Aug 17 17:04:56 user nova-compute[72724]: DEBUG nova.network.neutron [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated VIF entry in instance network info cache for port 33340ff4-9784-4089-ae55-33222223e2dd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG nova.network.neutron [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-776276e6-edf2-460a-8e23-3c765a1c6ae9 req-79613f5e-e8e2-4fe0-a500-ece1337f0166 service nova] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG os_brick.utils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0f9437-5944-404a-af07-e75b7899d630]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cbf468-fd55-4794-976f-f928ef228d01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd05ea8-9efb-4fd5-9fe5-9e9f78765f60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d60426-b988-4f57-ba8d-ec91d90d490f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:04:56 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:04:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51bbbf2-97c1-4a65-ba71-d1552786f622]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG os_brick.utils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating existing volume attachment record: 65754472-d2bd-42e7-8bde-65f4f9c617eb {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:04:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692291891.6866558, 8d21072e-5280-4475-8174-2cc84278cfaa => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:05:06 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] VM Stopped (Lifecycle Event)
Aug 17 17:05:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4f88b8db-501b-41b1-8d5e-83b00b8ec461 None None] [instance: 8d21072e-5280-4475-8174-2cc84278cfaa] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEfibwMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:05:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:05:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:05:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:05:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:05:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:05:06 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:05:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5b40d8-2c09-40fd-b4e5-15c8daaef5db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:05:07 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c727b-b9ce-41ba-a7ff-56dbfeeb5f9d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d] added
Aug 17 17:05:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a0e31b-4483-48ac-8a52-676195942aa7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aa1571-f716-40e1-9730-c81cab9a4f34]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KEfibwMt {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KEfibwMt" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4141dd41-4c54-4044-8884-270b1de8b886]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KEfibwMt'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1fdc800-775f-4acc-a45e-b60ac31556ee]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d32bcbf-a13b-4947-a552-183aaf083d8c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:05:07 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:05:07 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:05:07 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:05:07 user nova-compute[72724]: 
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0cec32-25d1-4605-96fe-1f43bb80e2e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260]
Aug 17 17:05:07 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260] successful.
Aug 17 17:05:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[605b9c92-e4bc-4220-a5ea-eea5e526b545]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e8f2af-6850-4dda-9447-fc2e9b5fb19e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d (non-flash)
Aug 17 17:05:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d (non-flash)
Aug 17 17:05:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6420b8-4f71-4217-8769-41f2d4f2daba]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:05:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEfibwMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23334353831643863', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334353831643863', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'flavor' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:05:08 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:05:08 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:05:08 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:05:08 user nova-compute[72724]:   <serial>b48199c6-f7f4-4372-a0c9-81601cfc253d</serial>
Aug 17 17:05:08 user nova-compute[72724]: </disk>
Aug 17 17:05:08 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No VIF found with MAC fa:16:3e:a9:16:1f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:05:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-01112c0a-8881-4d43-9a3c-ff2e014a39de tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.176s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:11 user nova-compute[72724]: INFO nova.compute.manager [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Detaching volume b48199c6-f7f4-4372-a0c9-81601cfc253d
Aug 17 17:05:11 user nova-compute[72724]: INFO nova.virt.block_device [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Attempting to driver detach volume b48199c6-f7f4-4372-a0c9-81601cfc253d from mountpoint /dev/vdb
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Attempting to detach device vdb from instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:05:11 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:05:11 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:05:11 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:05:11 user nova-compute[72724]:   <serial>b48199c6-f7f4-4372-a0c9-81601cfc253d</serial>
Aug 17 17:05:11 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:05:11 user nova-compute[72724]: </disk>
Aug 17 17:05:11 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:05:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully detached device vdb from instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 from the persistent domain config.
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:05:11 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:05:11 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:05:11 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:05:11 user nova-compute[72724]:   <serial>b48199c6-f7f4-4372-a0c9-81601cfc253d</serial>
Aug 17 17:05:11 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:05:11 user nova-compute[72724]: </disk>
Aug 17 17:05:11 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692291911.9261603, f116cdf6-59ef-48fd-850e-8cb5e206ecc0 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:05:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully detached device vdb from instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 from the live domain config.
Aug 17 17:05:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KEfibwMt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:05:11 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[75283ab5-cc56-4b29-83cb-2ca1abf00b9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a874e-2e55-4d6b-8958-bab8b41d26d7]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d (non-flash)
Aug 17 17:05:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d (non-flash)
Aug 17 17:05:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86ed6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:05:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c4036c-e9c4-4f30-8c27-7b1a5fa42bdc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ecdaee-0a48-4363-98c1-3cf58956ec73]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8da459-18a0-4c6f-9db9-04cdda4e443c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bff4b5-01c1-4859-a6a9-f548620c8294]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56b56b2-1aa1-4c01-9f22-7bd3c7d50819]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[55228aa4-e782-4a63-8025-95853b7ed290]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260]
Aug 17 17:05:12 user nova-compute[72724]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d, portal: 172.16.0.220,3260] successful.
Aug 17 17:05:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b48199c6-f7f4-4372-a0c9-81601cfc253d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1a584a-4018-4c9e-9af2-48c38a31903f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] <== disconnect_volume: return (259ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.objects.instance [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'flavor' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-689bc6b8-d9d1-452e-9cae-927463b016d3 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.667s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:13 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:05:13 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8804MB free_disk=25.427391052246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:05:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:05:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:05:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:05:44 user nova-compute[72724]: INFO nova.compute.claims [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Claim successful on node user
Aug 17 17:05:44 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:05:44 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.201s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:05:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.policy [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '614e07eba6ae432598427f2e4f256165', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d7338ba99b04595b7ff8ceca1951aea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:05:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Creating image(s)
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "/opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "/opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "/opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk 1073741824" returned: 0 in 0.053s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Successfully created port: 69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 17:05:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Cannot resize image /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'migration_context' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Ensure instance console log exists: /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Successfully updated port: 69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquired lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-changed-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Refreshing instance network info cache due to event network-changed-69cd0729-f24f-4989-8fe9-18b1d56137d2. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] Acquiring lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating instance_info_cache with network_info: [{"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Releasing lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Instance network_info: |[{"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] Acquired lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Refreshing network info cache for port 69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Start _get_guest_xml network_info=[{"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:05:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:05:46 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:05:46 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522859522',display_name='tempest-AttachVolumeTestJSON-server-522859522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-522859522',id=44,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAYEoQukNXOA9F2zMdIFlEzwLrIXJP4Vv19H/D081J3ZtGD9fU7oaXPCcGBJSA8qbTfxYvX3iOHRp9aWMh2jtC5O/mTFmwM6VLWD5wZxZbstTS7GeOmeoXWetkGFUy5BA==',key_name='tempest-keypair-496227015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-ltluz3sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=c4eef425-ad74-4af9-9ca7-50995c6d03ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.objects.instance [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'pci_devices' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:05:47 user nova-compute[72724]:   <uuid>c4eef425-ad74-4af9-9ca7-50995c6d03ba</uuid>
Aug 17 17:05:47 user nova-compute[72724]:   <name>instance-0000002c</name>
Aug 17 17:05:47 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:05:47 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:05:47 user nova-compute[72724]:   <metadata>
Aug 17 17:05:47 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:05:47 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:05:47 user nova-compute[72724]:       <nova:name>tempest-AttachVolumeTestJSON-server-522859522</nova:name>
Aug 17 17:05:47 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:05:46</nova:creationTime>
Aug 17 17:05:47 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:05:47 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:05:47 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:05:47 user nova-compute[72724]:       <nova:owner>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:user uuid="614e07eba6ae432598427f2e4f256165">tempest-AttachVolumeTestJSON-921709659-project-member</nova:user>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:project uuid="7d7338ba99b04595b7ff8ceca1951aea">tempest-AttachVolumeTestJSON-921709659</nova:project>
Aug 17 17:05:47 user nova-compute[72724]:       </nova:owner>
Aug 17 17:05:47 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 17:05:47 user nova-compute[72724]:       <nova:ports>
Aug 17 17:05:47 user nova-compute[72724]:         <nova:port uuid="69cd0729-f24f-4989-8fe9-18b1d56137d2">
Aug 17 17:05:47 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 17 17:05:47 user nova-compute[72724]:         </nova:port>
Aug 17 17:05:47 user nova-compute[72724]:       </nova:ports>
Aug 17 17:05:47 user nova-compute[72724]:     </nova:instance>
Aug 17 17:05:47 user nova-compute[72724]:   </metadata>
Aug 17 17:05:47 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:05:47 user nova-compute[72724]:     <system>
Aug 17 17:05:47 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:05:47 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:05:47 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:05:47 user nova-compute[72724]:       <entry name="serial">c4eef425-ad74-4af9-9ca7-50995c6d03ba</entry>
Aug 17 17:05:47 user nova-compute[72724]:       <entry name="uuid">c4eef425-ad74-4af9-9ca7-50995c6d03ba</entry>
Aug 17 17:05:47 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:05:47 user nova-compute[72724]:     </system>
Aug 17 17:05:47 user nova-compute[72724]:   </sysinfo>
Aug 17 17:05:47 user nova-compute[72724]:   <os>
Aug 17 17:05:47 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:05:47 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:05:47 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:05:47 user nova-compute[72724]:   </os>
Aug 17 17:05:47 user nova-compute[72724]:   <features>
Aug 17 17:05:47 user nova-compute[72724]:     <acpi/>
Aug 17 17:05:47 user nova-compute[72724]:     <apic/>
Aug 17 17:05:47 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:05:47 user nova-compute[72724]:   </features>
Aug 17 17:05:47 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:05:47 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:05:47 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:05:47 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:05:47 user nova-compute[72724]:   </clock>
Aug 17 17:05:47 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:05:47 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:05:47 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:05:47 user nova-compute[72724]:   </cpu>
Aug 17 17:05:47 user nova-compute[72724]:   <devices>
Aug 17 17:05:47 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 17:05:47 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 17:05:47 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk"/>
Aug 17 17:05:47 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:05:47 user nova-compute[72724]:     </disk>
Aug 17 17:05:47 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:05:47 user nova-compute[72724]:       <mac address="fa:16:3e:5c:e6:4f"/>
Aug 17 17:05:47 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:05:47 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:05:47 user nova-compute[72724]:       <target dev="tap69cd0729-f2"/>
Aug 17 17:05:47 user nova-compute[72724]:     </interface>
Aug 17 17:05:47 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:05:47 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/console.log" append="off"/>
Aug 17 17:05:47 user nova-compute[72724]:     </serial>
Aug 17 17:05:47 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:05:47 user nova-compute[72724]:     <video>
Aug 17 17:05:47 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:05:47 user nova-compute[72724]:     </video>
Aug 17 17:05:47 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:05:47 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:05:47 user nova-compute[72724]:     </rng>
Aug 17 17:05:47 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:05:47 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:05:47 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:05:47 user nova-compute[72724]:     </memballoon>
Aug 17 17:05:47 user nova-compute[72724]:   </devices>
Aug 17 17:05:47 user nova-compute[72724]: </domain>
Aug 17 17:05:47 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522859522',display_name='tempest-AttachVolumeTestJSON-server-522859522',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-522859522',id=44,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAYEoQukNXOA9F2zMdIFlEzwLrIXJP4Vv19H/D081J3ZtGD9fU7oaXPCcGBJSA8qbTfxYvX3iOHRp9aWMh2jtC5O/mTFmwM6VLWD5wZxZbstTS7GeOmeoXWetkGFUy5BA==',key_name='tempest-keypair-496227015',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-ltluz3sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:05:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=c4eef425-ad74-4af9-9ca7-50995c6d03ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG os_vif [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69cd0729-f2, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap69cd0729-f2, col_values=(('external_ids', {'iface-id': '69cd0729-f24f-4989-8fe9-18b1d56137d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:e6:4f', 'vm-uuid': 'c4eef425-ad74-4af9-9ca7-50995c6d03ba'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:47 user nova-compute[72724]: INFO os_vif [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2')
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No VIF found with MAC fa:16:3e:5c:e6:4f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updated VIF entry in instance network info cache for port 69cd0729-f24f-4989-8fe9-18b1d56137d2. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating instance_info_cache with network_info: [{"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:05:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bb2759d1-0eac-4ccb-b0eb-4dd97f886339 req-72aa6eae-b26e-425a-b978-2d2a89a5451a service nova] Releasing lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-0b2a0cf3-e487-4669-b2ba-39476db02ae2 req-dcfea534-5d07-4265-9181-9f1b4bb22367 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0b2a0cf3-e487-4669-b2ba-39476db02ae2 req-dcfea534-5d07-4265-9181-9f1b4bb22367 service nova] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0b2a0cf3-e487-4669-b2ba-39476db02ae2 req-dcfea534-5d07-4265-9181-9f1b4bb22367 service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0b2a0cf3-e487-4669-b2ba-39476db02ae2 req-dcfea534-5d07-4265-9181-9f1b4bb22367 service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-0b2a0cf3-e487-4669-b2ba-39476db02ae2 req-dcfea534-5d07-4265-9181-9f1b4bb22367 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] No waiting events found dispatching network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:05:48 user nova-compute[72724]: WARNING nova.compute.manager [req-0b2a0cf3-e487-4669-b2ba-39476db02ae2 req-dcfea534-5d07-4265-9181-9f1b4bb22367 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received unexpected event network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 for instance with vm_state building and task_state spawning.
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291950.4811301, c4eef425-ad74-4af9-9ca7-50995c6d03ba => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] VM Resumed (Lifecycle Event)
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Instance spawned successfully.
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291950.4827244, c4eef425-ad74-4af9-9ca7-50995c6d03ba => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] VM Started (Lifecycle Event)
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Took 5.33 seconds to spawn the instance on the hypervisor.
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:05:50 user nova-compute[72724]: INFO nova.compute.manager [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Took 5.86 seconds to build instance.
Aug 17 17:05:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-1009639e-d988-41e4-a315-84f6667d6b0d tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.954s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b2b806ac-25ee-41ba-8f9d-c40810f45ac7 req-226cf383-5124-4d07-be57-9040bc51f13f service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b2b806ac-25ee-41ba-8f9d-c40810f45ac7 req-226cf383-5124-4d07-be57-9040bc51f13f service nova] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b2b806ac-25ee-41ba-8f9d-c40810f45ac7 req-226cf383-5124-4d07-be57-9040bc51f13f service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b2b806ac-25ee-41ba-8f9d-c40810f45ac7 req-226cf383-5124-4d07-be57-9040bc51f13f service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:05:50 user nova-compute[72724]: DEBUG nova.compute.manager [req-b2b806ac-25ee-41ba-8f9d-c40810f45ac7 req-226cf383-5124-4d07-be57-9040bc51f13f service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] No waiting events found dispatching network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:05:50 user nova-compute[72724]: WARNING nova.compute.manager [req-b2b806ac-25ee-41ba-8f9d-c40810f45ac7 req-226cf383-5124-4d07-be57-9040bc51f13f service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received unexpected event network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 for instance with vm_state active and task_state None.
Aug 17 17:05:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:05:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:06:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:06:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:06:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:06:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:06:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:06:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:06:07 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:06:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:06:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:06:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:06:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:06:11 user nova-compute[72724]: INFO nova.compute.manager [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] instance snapshotting
Aug 17 17:06:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Beginning live snapshot process
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json -f qcow2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi20nsjae/21fbe6cae278480e8543ec5159e607e2.delta 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi20nsjae/21fbe6cae278480e8543ec5159e607e2.delta 1073741824" returned: 0 in 0.052s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 17 17:06:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 17:06:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72724) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 17 17:06:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 17 17:06:13 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 17:06:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi20nsjae/21fbe6cae278480e8543ec5159e607e2.delta /opt/stack/data/nova/instances/snapshots/tmpi20nsjae/21fbe6cae278480e8543ec5159e607e2 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi20nsjae/21fbe6cae278480e8543ec5159e607e2.delta /opt/stack/data/nova/instances/snapshots/tmpi20nsjae/21fbe6cae278480e8543ec5159e607e2" returned: 0 in 0.516s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:13 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Snapshot extracted, beginning image upload
Aug 17 17:06:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:06:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:14 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:06:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:15 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:06:15 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:06:15 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8627MB free_disk=25.350017547607422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4eef425-ad74-4af9-9ca7-50995c6d03ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:06:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Snapshot image upload complete
Aug 17 17:06:16 user nova-compute[72724]: INFO nova.compute.manager [None req-e8a85c7d-5024-4799-a668-78fbca6e8a4a tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Took 5.06 seconds to snapshot the instance on the hypervisor.
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:06:17 user nova-compute[72724]: INFO nova.compute.claims [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Claim successful on node user
Aug 17 17:06:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:06:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.237s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:06:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.policy [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '020bea0e49c240dc81da4a3a9a05fe12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec3b5e6a29fa4a889f7e14003ed3a453', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:06:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Creating image(s)
Aug 17 17:06:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "/opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "/opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "/opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "ba095d4a14636514051aab865645cffb1499e31e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "ba095d4a14636514051aab865645cffb1499e31e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.part --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Successfully created port: d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.part --force-share --output=json" returned: 0 in 0.247s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG nova.virt.images [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] e8f5a4aa-2c92-409a-ba37-51d9ce37ec83 was qcow2, converting to raw {{(pid=72724) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG nova.privsep.utils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72724) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.part /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.converted {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.part /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.converted" returned: 0 in 0.321s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.converted --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e.converted --force-share --output=json" returned: 0 in 0.246s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "ba095d4a14636514051aab865645cffb1499e31e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.819s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e --force-share --output=json" returned: 0 in 0.206s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "ba095d4a14636514051aab865645cffb1499e31e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "ba095d4a14636514051aab865645cffb1499e31e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Successfully updated port: d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquired lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-changed-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Refreshing instance network info cache due to event network-changed-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] Acquiring lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e --force-share --output=json" returned: 0 in 0.235s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e,backing_fmt=raw /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e,backing_fmt=raw /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk 1073741824" returned: 0 in 0.367s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "ba095d4a14636514051aab865645cffb1499e31e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.608s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.objects.instance [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'migration_context' on Instance uuid 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating instance_info_cache with network_info: [{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Ensure instance console log exists: /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Releasing lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Instance network_info: |[{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] Acquired lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Refreshing network info cache for port d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Start _get_guest_xml network_info=[{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='fdf38e66d388ed195ba447aa51e5f8a2',container_format='bare',created_at=2023-08-17T17:06:11Z,direct_url=<?>,disk_format='qcow2',id=e8f5a4aa-2c92-409a-ba37-51d9ce37ec83,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2109613313',owner='ec3b5e6a29fa4a889f7e14003ed3a453',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T17:06:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': 'e8f5a4aa-2c92-409a-ba37-51d9ce37ec83'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:06:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:06:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='fdf38e66d388ed195ba447aa51e5f8a2',container_format='bare',created_at=2023-08-17T17:06:11Z,direct_url=<?>,disk_format='qcow2',id=e8f5a4aa-2c92-409a-ba37-51d9ce37ec83,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2109613313',owner='ec3b5e6a29fa4a889f7e14003ed3a453',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-17T17:06:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1803602912',display_name='tempest-TestStampPattern-server-1803602912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1803602912',id=45,image_ref='e8f5a4aa-2c92-409a-ba37-51d9ce37ec83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXYKcFPVGOL27nygfwan9oKUSyPDhwCmmd9xaTXKo6Oy+FXvrn7pGndZRwFepyZ++VdvRLoFLRME2rOGBGwWO9muZKyZr9tL1cDRihzIsoTmp0UWvUV5c2HXvZei+4eIg==',key_name='tempest-TestStampPattern-221982094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec3b5e6a29fa4a889f7e14003ed3a453',ramdisk_id='',reservation_id='r-6gah0efh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f116cdf6-59ef-48fd-850e-8cb5e206ecc0',image_min_disk='1',image_min_ram='0',image_owner_id='ec3b5e6a29fa4a889f7e14003ed3a453',image_owner_project_name='tempest-TestStampPattern-249761649',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-249761649-project-member',image_user_id='020bea0e49c240dc81da4a3a9a05fe12',network_allocated='True',owner_project_name='tempest-TestStampPattern-249761649',owner_user_name='tempest-TestStampPattern-249761649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:06:18Z,user_data=None,user_id='020bea0e49c240dc81da4a3a9a05fe12',uuid=4fe643e3-5fbc-43b2-8268-d30572065a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converting VIF {"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.objects.instance [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'pci_devices' on Instance uuid 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:06:21 user nova-compute[72724]:   <uuid>4fe643e3-5fbc-43b2-8268-d30572065a50</uuid>
Aug 17 17:06:21 user nova-compute[72724]:   <name>instance-0000002d</name>
Aug 17 17:06:21 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:06:21 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:06:21 user nova-compute[72724]:   <metadata>
Aug 17 17:06:21 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:06:21 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:06:21 user nova-compute[72724]:       <nova:name>tempest-TestStampPattern-server-1803602912</nova:name>
Aug 17 17:06:21 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:06:21</nova:creationTime>
Aug 17 17:06:21 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:06:21 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:06:21 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:06:21 user nova-compute[72724]:       <nova:owner>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:user uuid="020bea0e49c240dc81da4a3a9a05fe12">tempest-TestStampPattern-249761649-project-member</nova:user>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:project uuid="ec3b5e6a29fa4a889f7e14003ed3a453">tempest-TestStampPattern-249761649</nova:project>
Aug 17 17:06:21 user nova-compute[72724]:       </nova:owner>
Aug 17 17:06:21 user nova-compute[72724]:       <nova:root type="image" uuid="e8f5a4aa-2c92-409a-ba37-51d9ce37ec83"/>
Aug 17 17:06:21 user nova-compute[72724]:       <nova:ports>
Aug 17 17:06:21 user nova-compute[72724]:         <nova:port uuid="d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43">
Aug 17 17:06:21 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 17:06:21 user nova-compute[72724]:         </nova:port>
Aug 17 17:06:21 user nova-compute[72724]:       </nova:ports>
Aug 17 17:06:21 user nova-compute[72724]:     </nova:instance>
Aug 17 17:06:21 user nova-compute[72724]:   </metadata>
Aug 17 17:06:21 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:06:21 user nova-compute[72724]:     <system>
Aug 17 17:06:21 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:06:21 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:06:21 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:06:21 user nova-compute[72724]:       <entry name="serial">4fe643e3-5fbc-43b2-8268-d30572065a50</entry>
Aug 17 17:06:21 user nova-compute[72724]:       <entry name="uuid">4fe643e3-5fbc-43b2-8268-d30572065a50</entry>
Aug 17 17:06:21 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:06:21 user nova-compute[72724]:     </system>
Aug 17 17:06:21 user nova-compute[72724]:   </sysinfo>
Aug 17 17:06:21 user nova-compute[72724]:   <os>
Aug 17 17:06:21 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:06:21 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:06:21 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:06:21 user nova-compute[72724]:   </os>
Aug 17 17:06:21 user nova-compute[72724]:   <features>
Aug 17 17:06:21 user nova-compute[72724]:     <acpi/>
Aug 17 17:06:21 user nova-compute[72724]:     <apic/>
Aug 17 17:06:21 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:06:21 user nova-compute[72724]:   </features>
Aug 17 17:06:21 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:06:21 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:06:21 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:06:21 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:06:21 user nova-compute[72724]:   </clock>
Aug 17 17:06:21 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:06:21 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:06:21 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:06:21 user nova-compute[72724]:   </cpu>
Aug 17 17:06:21 user nova-compute[72724]:   <devices>
Aug 17 17:06:21 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 17:06:21 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 17:06:21 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk"/>
Aug 17 17:06:21 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:06:21 user nova-compute[72724]:     </disk>
Aug 17 17:06:21 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:06:21 user nova-compute[72724]:       <mac address="fa:16:3e:21:e0:98"/>
Aug 17 17:06:21 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:06:21 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:06:21 user nova-compute[72724]:       <target dev="tapd24bc58f-9b"/>
Aug 17 17:06:21 user nova-compute[72724]:     </interface>
Aug 17 17:06:21 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:06:21 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/console.log" append="off"/>
Aug 17 17:06:21 user nova-compute[72724]:     </serial>
Aug 17 17:06:21 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:06:21 user nova-compute[72724]:     <video>
Aug 17 17:06:21 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:06:21 user nova-compute[72724]:     </video>
Aug 17 17:06:21 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:06:21 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:06:21 user nova-compute[72724]:     </rng>
Aug 17 17:06:21 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:06:21 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:06:21 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:06:21 user nova-compute[72724]:     </memballoon>
Aug 17 17:06:21 user nova-compute[72724]:   </devices>
Aug 17 17:06:21 user nova-compute[72724]: </domain>
Aug 17 17:06:21 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1803602912',display_name='tempest-TestStampPattern-server-1803602912',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1803602912',id=45,image_ref='e8f5a4aa-2c92-409a-ba37-51d9ce37ec83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXYKcFPVGOL27nygfwan9oKUSyPDhwCmmd9xaTXKo6Oy+FXvrn7pGndZRwFepyZ++VdvRLoFLRME2rOGBGwWO9muZKyZr9tL1cDRihzIsoTmp0UWvUV5c2HXvZei+4eIg==',key_name='tempest-TestStampPattern-221982094',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec3b5e6a29fa4a889f7e14003ed3a453',ramdisk_id='',reservation_id='r-6gah0efh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f116cdf6-59ef-48fd-850e-8cb5e206ecc0',image_min_disk='1',image_min_ram='0',image_owner_id='ec3b5e6a29fa4a889f7e14003ed3a453',image_owner_project_name='tempest-TestStampPattern-249761649',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-249761649-project-member',image_user_id='020bea0e49c240dc81da4a3a9a05fe12',network_allocated='True',owner_project_name='tempest-TestStampPattern-249761649',owner_user_name='tempest-TestStampPattern-249761649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:06:18Z,user_data=None,user_id='020bea0e49c240dc81da4a3a9a05fe12',uuid=4fe643e3-5fbc-43b2-8268-d30572065a50,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converting VIF {"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG os_vif [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd24bc58f-9b, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd24bc58f-9b, col_values=(('external_ids', {'iface-id': 'd24bc58f-9bf3-4b6e-88bf-9a6f454d2d43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:e0:98', 'vm-uuid': '4fe643e3-5fbc-43b2-8268-d30572065a50'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:21 user nova-compute[72724]: INFO os_vif [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b')
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No VIF found with MAC fa:16:3e:21:e0:98, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updated VIF entry in instance network info cache for port d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating instance_info_cache with network_info: [{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-6ecfc104-dc51-4da6-a480-2e1cf8e7d59e req-b189b788-4cfd-46db-88ac-22a31f6c4ecb service nova] Releasing lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:06:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-ac7f9428-4c38-49e9-97f9-133c143908ed req-59d6988e-78d6-4cc0-ae88-443bedcb481c service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac7f9428-4c38-49e9-97f9-133c143908ed req-59d6988e-78d6-4cc0-ae88-443bedcb481c service nova] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac7f9428-4c38-49e9-97f9-133c143908ed req-59d6988e-78d6-4cc0-ae88-443bedcb481c service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ac7f9428-4c38-49e9-97f9-133c143908ed req-59d6988e-78d6-4cc0-ae88-443bedcb481c service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-ac7f9428-4c38-49e9-97f9-133c143908ed req-59d6988e-78d6-4cc0-ae88-443bedcb481c service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] No waiting events found dispatching network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:06:22 user nova-compute[72724]: WARNING nova.compute.manager [req-ac7f9428-4c38-49e9-97f9-133c143908ed req-59d6988e-78d6-4cc0-ae88-443bedcb481c service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received unexpected event network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 for instance with vm_state building and task_state spawning.
Aug 17 17:06:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291984.752001, 4fe643e3-5fbc-43b2-8268-d30572065a50 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] VM Resumed (Lifecycle Event)
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Instance spawned successfully.
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692291984.75365, 4fe643e3-5fbc-43b2-8268-d30572065a50 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] VM Started (Lifecycle Event)
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Took 6.60 seconds to spawn the instance on the hypervisor.
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-eb61fab0-0496-4b83-bea4-9c9ef6f243df req-93ec3743-0784-44c6-b041-a62416ac0a99 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb61fab0-0496-4b83-bea4-9c9ef6f243df req-93ec3743-0784-44c6-b041-a62416ac0a99 service nova] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb61fab0-0496-4b83-bea4-9c9ef6f243df req-93ec3743-0784-44c6-b041-a62416ac0a99 service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-eb61fab0-0496-4b83-bea4-9c9ef6f243df req-93ec3743-0784-44c6-b041-a62416ac0a99 service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-eb61fab0-0496-4b83-bea4-9c9ef6f243df req-93ec3743-0784-44c6-b041-a62416ac0a99 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] No waiting events found dispatching network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:06:24 user nova-compute[72724]: WARNING nova.compute.manager [req-eb61fab0-0496-4b83-bea4-9c9ef6f243df req-93ec3743-0784-44c6-b041-a62416ac0a99 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received unexpected event network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 for instance with vm_state building and task_state spawning.
Aug 17 17:06:24 user nova-compute[72724]: INFO nova.compute.manager [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Took 7.17 seconds to build instance.
Aug 17 17:06:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-973fbd90-cb18-4a37-951b-57090613412b tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.261s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:06:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:06:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:07:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:07:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:07:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:07:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:07:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating instance_info_cache with network_info: [{"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:07:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:07:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:07:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:07:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:07:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:07:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:07:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:07:14 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:07:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:07:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8590MB free_disk=25.251384735107422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4eef425-ad74-4af9-9ca7-50995c6d03ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 4fe643e3-5fbc-43b2-8268-d30572065a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:07:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.257s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:07:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:07:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:07:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-changed-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG nova.compute.manager [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Refreshing instance network info cache due to event network-changed-69cd0729-f24f-4989-8fe9-18b1d56137d2. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] Acquiring lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] Acquired lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Refreshing network info cache for port 69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updated VIF entry in instance network info cache for port 69cd0729-f24f-4989-8fe9-18b1d56137d2. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating instance_info_cache with network_info: [{"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fd732aac-5d26-448f-80ad-afbd88dbc442 req-ac90304e-cc68-4219-a29c-4dcb29bef6f6 service nova] Releasing lock "refresh_cache-c4eef425-ad74-4af9-9ca7-50995c6d03ba" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:07:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:07:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:07:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:07:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:07:40 user nova-compute[72724]: INFO nova.compute.manager [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attaching volume a7baef77-60b5-4dc1-af73-b74a81d57046 to /dev/vdb
Aug 17 17:07:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba6c7d9-4a33-45fa-a63d-be569a981201]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee50c0-1734-4268-9cdd-388cb3506d69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5190e410-d5bb-4fe1-9713-1c4fc8080dd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[062e21bf-459e-4943-b5a3-09121ab38dbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:07:40 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:07:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03d4c7f-061e-4492-bbd6-64142e88f4d7]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:07:40 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating existing volume attachment record: 816fd02c-5551-4a27-91e7-5504ddce9ed1 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:07:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abDXrsuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:07:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:07:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:07:50 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ca6dad-57b4-4373-863f-2d069f5dc60b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:07:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05435b52-c7f1-4bbf-b26d-7dcd1c5edecb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046] added
Aug 17 17:07:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85d6170-d3c1-4e83-8078-755ff6bfe760]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfee648-b8d4-43b6-bb25-c53eeead87e9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abDXrsuh {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v abDXrsuh" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7fedca-1358-4150-b050-3593d258c8f5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'abDXrsuh'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1eaab0-6477-443a-b90b-dad3814be88a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c761309-c313-41c2-b0ad-88ef50d0edef]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:07:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:07:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:07:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:07:50 user nova-compute[72724]: 
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aeb954a-c1ab-43e6-b668-dc1c942e98ee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260]
Aug 17 17:07:50 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260] successful.
Aug 17 17:07:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2a1217-b7cf-4151-aef0-823b9f5b1f90]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2999cd29-7264-4bf8-b08d-f7629b3cf46b]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:07:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:07:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4d41f1-053c-440b-b082-2086df17e560]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:07:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abDXrsuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23162353838323063', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162353838323063', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:07:51 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:07:51 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:07:51 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:07:51 user nova-compute[72724]:   <serial>a7baef77-60b5-4dc1-af73-b74a81d57046</serial>
Aug 17 17:07:51 user nova-compute[72724]: </disk>
Aug 17 17:07:51 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:07:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:07:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:07:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No VIF found with MAC fa:16:3e:5c:e6:4f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:07:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ce52d041-738d-43ef-8e3b-d5a63d0789f4 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.299s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:07:56 user nova-compute[72724]: INFO nova.compute.manager [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attaching volume 502b84f7-9811-4f76-b482-82ea519cd46f to /dev/vdc
Aug 17 17:07:56 user nova-compute[72724]: DEBUG os_brick.utils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[52086fc7-1946-426b-be4b-512c761bc524]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[948a5a31-5cf8-4be1-abd9-0080dd33e4bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21966f3-d928-459c-a245-fe5db4961369]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bb54ef-1549-45bf-a0c9-9d176a4921b1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:07:56 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:07:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e45518-e0c6-4a1c-a793-85f20b00d0e3]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG os_brick.utils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:07:56 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating existing volume attachment record: cda4d75b-de92-42d8-a9d6-60957b98882d {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:07:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:08:05 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpzEqjua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:08:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:06 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d531e255-77f2-475b-a865-26f3531b27c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:08:06 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1293a7-0223-4074-8636-6f5d2d50506d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f] added
Aug 17 17:08:06 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b827ada-3dd6-49a7-9485-775a737a2306]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9885dc1-95cd-44f7-b649-588b9181898b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpzEqjua {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BpzEqjua" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5230a63f-16f7-4fc3-b9b0-9db65533042a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BpzEqjua'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b982465-9ed1-42f5-94d6-ba22b46d45e7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4c9535-cd6c-4a8e-8b30-f196541b0791]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:08:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:08:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d1c9db-a624-4725-aee1-c64b86da5dfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260]
Aug 17 17:08:07 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260] successful.
Aug 17 17:08:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f24337f-9333-4bee-b154-b10ed541c9d1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0931f05e-c0d4-40fa-ae7d-49e13d487262]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:08:07 user nova-compute[72724]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)
Aug 17 17:08:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:08:07 user nova-compute[72724]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)
Aug 17 17:08:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c722cf3-a664-443e-9535-170ff03b986e]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpzEqjua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23566353230366335', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566353230366335', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:08:08 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:08 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:08:08 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 17:08:08 user nova-compute[72724]:   <serial>502b84f7-9811-4f76-b482-82ea519cd46f</serial>
Aug 17 17:08:08 user nova-compute[72724]: </disk>
Aug 17 17:08:08 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] No VIF found with MAC fa:16:3e:5c:e6:4f, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:08:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8749007-117e-4446-9414-f4a9a231a9c2 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.137s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-changed-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:08:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Refreshing instance network info cache due to event network-changed-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:08:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] Acquiring lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:08:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] Acquired lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:08:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Refreshing network info cache for port d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:10 user nova-compute[72724]: INFO nova.compute.manager [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Detaching volume a7baef77-60b5-4dc1-af73-b74a81d57046
Aug 17 17:08:10 user nova-compute[72724]: INFO nova.virt.block_device [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attempting to driver detach volume a7baef77-60b5-4dc1-af73-b74a81d57046 from mountpoint /dev/vdb
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Attempting to detach device vdb from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:08:10 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:10 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:08:10 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:08:10 user nova-compute[72724]:   <serial>a7baef77-60b5-4dc1-af73-b74a81d57046</serial>
Aug 17 17:08:10 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:08:10 user nova-compute[72724]: </disk>
Aug 17 17:08:10 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:08:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully detached device vdb from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the persistent domain config.
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:08:10 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:10 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:08:10 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:08:10 user nova-compute[72724]:   <serial>a7baef77-60b5-4dc1-af73-b74a81d57046</serial>
Aug 17 17:08:10 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:08:10 user nova-compute[72724]: </disk>
Aug 17 17:08:10 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updated VIF entry in instance network info cache for port d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating instance_info_cache with network_info: [{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-497e17b5-505b-4c5d-95c9-d23938bfa666 req-f06c5d88-da03-4d50-acec-b48c3b13743a service nova] Releasing lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292090.626358, c4eef425-ad74-4af9-9ca7-50995c6d03ba => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:08:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully detached device vdb from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the live domain config.
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'abDXrsuh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:08:10 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee030a3-dc86-481f-8008-902eb7df1650]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b12d57-3315-4e19-852e-9ab98f513b36]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:08:10 user nova-compute[72724]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)
Aug 17 17:08:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 (non-flash)
Aug 17 17:08:10 user nova-compute[72724]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)
Aug 17 17:08:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86bb2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb435b6a-0680-4001-b380-851d5f71b91e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0526973-4ea7-430f-a87c-bf6537ac8ce5]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[edecf003-b7e1-4c0c-82df-830a9521bf42]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1bf1c-013d-4b50-8e90-46405f90f5e4]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b1f789-c827-4d24-97d1-2ebd4099648c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bc52b0-7dae-48bd-babf-1cd7f9f77f8b]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260]
Aug 17 17:08:10 user nova-compute[72724]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046, portal: 172.16.0.220,3260] successful.
Aug 17 17:08:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a7baef77-60b5-4dc1-af73-b74a81d57046 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac95e64-ffbf-462b-a1b5-ff2073446f80]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== disconnect_volume: return (282ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:08:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'flavor' on Instance uuid 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:11 user nova-compute[72724]: INFO nova.compute.manager [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Attaching volume eaaaa8f7-6b0c-4338-b8e6-614705c7c5af to /dev/vdb
Aug 17 17:08:11 user nova-compute[72724]: DEBUG os_brick.utils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[095343f3-27c9-4b81-be24-ac59140ccc86]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c40067-021c-4b62-ad9c-c380d967543b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcad577-f5e0-4987-b493-3f43c2bdcd1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5e6798-de61-4dcf-b5e8-4d901404b0ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:08:11 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d677224e-b1db-4011-a613-3d8e30bd9aff]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG os_brick.utils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating existing volume attachment record: 6f4490aa-d96c-41c8-831b-187677ba542a {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG nova.objects.instance [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-60c75818-96bf-4876-82c7-3b6f3a20e172 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.685s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:12 user nova-compute[72724]: INFO nova.compute.manager [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Detaching volume 502b84f7-9811-4f76-b482-82ea519cd46f
Aug 17 17:08:12 user nova-compute[72724]: INFO nova.virt.block_device [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Attempting to driver detach volume 502b84f7-9811-4f76-b482-82ea519cd46f from mountpoint /dev/vdc
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Attempting to detach device vdc from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:08:12 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:12 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:08:12 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 17:08:12 user nova-compute[72724]:   <serial>502b84f7-9811-4f76-b482-82ea519cd46f</serial>
Aug 17 17:08:12 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 17:08:12 user nova-compute[72724]: </disk>
Aug 17 17:08:12 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:08:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully detached device vdc from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the persistent domain config.
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:08:12 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:12 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:08:12 user nova-compute[72724]:   <target dev="vdc" bus="virtio"/>
Aug 17 17:08:12 user nova-compute[72724]:   <serial>502b84f7-9811-4f76-b482-82ea519cd46f</serial>
Aug 17 17:08:12 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 17 17:08:12 user nova-compute[72724]: </disk>
Aug 17 17:08:12 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292092.94841, c4eef425-ad74-4af9-9ca7-50995c6d03ba => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:08:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully detached device vdc from instance c4eef425-ad74-4af9-9ca7-50995c6d03ba from the live domain config.
Aug 17 17:08:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BpzEqjua', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:08:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7e3efb-7f41-4160-a7f2-4831e1fbd4c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0416f552-fe93-4e03-a8ee-8f327649bd4c]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)
Aug 17 17:08:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f (non-flash)
Aug 17 17:08:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81dc820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb9a814-6245-447c-9355-14509383e29f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60f3b3c-2aad-4ee2-941c-afa160117940]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[afde0d26-21c5-49b0-9731-ca46dc1722bb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f580c6-acb7-49bd-bdf6-a6139c25fdd5]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c4adaa-f177-425e-ac43-570bfd5613ef]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa532dc9-4720-4f58-821a-db2be7193878]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260]
Aug 17 17:08:13 user nova-compute[72724]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f, portal: 172.16.0.220,3260] successful.
Aug 17 17:08:13 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:502b84f7-9811-4f76-b482-82ea519cd46f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[432cfafd-043e-4b82-83b0-e37fc05825da]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.248s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] <== disconnect_volume: return (250ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG nova.objects.instance [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'flavor' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-11818364-6da4-4226-a952-474f5394d612 tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.541s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:15 user nova-compute[72724]: INFO nova.compute.manager [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Terminating instance
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f83f403d-2390-47d9-9089-1a33d1829cd9 req-6ee820b8-5bc0-44b4-8a92-537aa916c663 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-vif-unplugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f83f403d-2390-47d9-9089-1a33d1829cd9 req-6ee820b8-5bc0-44b4-8a92-537aa916c663 service nova] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f83f403d-2390-47d9-9089-1a33d1829cd9 req-6ee820b8-5bc0-44b4-8a92-537aa916c663 service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f83f403d-2390-47d9-9089-1a33d1829cd9 req-6ee820b8-5bc0-44b4-8a92-537aa916c663 service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f83f403d-2390-47d9-9089-1a33d1829cd9 req-6ee820b8-5bc0-44b4-8a92-537aa916c663 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] No waiting events found dispatching network-vif-unplugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f83f403d-2390-47d9-9089-1a33d1829cd9 req-6ee820b8-5bc0-44b4-8a92-537aa916c663 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-vif-unplugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Instance destroyed successfully.
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lazy-loading 'resources' on Instance uuid c4eef425-ad74-4af9-9ca7-50995c6d03ba {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:05:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-522859522',display_name='tempest-AttachVolumeTestJSON-server-522859522',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-522859522',id=44,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNAYEoQukNXOA9F2zMdIFlEzwLrIXJP4Vv19H/D081J3ZtGD9fU7oaXPCcGBJSA8qbTfxYvX3iOHRp9aWMh2jtC5O/mTFmwM6VLWD5wZxZbstTS7GeOmeoXWetkGFUy5BA==',key_name='tempest-keypair-496227015',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:05:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d7338ba99b04595b7ff8ceca1951aea',ramdisk_id='',reservation_id='r-ltluz3sb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-921709659',owner_user_name='tempest-AttachVolumeTestJSON-921709659-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:05:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='614e07eba6ae432598427f2e4f256165',uuid=c4eef425-ad74-4af9-9ca7-50995c6d03ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converting VIF {"id": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "address": "fa:16:3e:5c:e6:4f", "network": {"id": "f66b4945-a5d9-4ac0-988e-b6fca46a2bcb", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-678121678-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d7338ba99b04595b7ff8ceca1951aea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69cd0729-f2", "ovs_interfaceid": "69cd0729-f24f-4989-8fe9-18b1d56137d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG os_vif [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69cd0729-f2, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:08:15 user nova-compute[72724]: INFO os_vif [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:e6:4f,bridge_name='br-int',has_traffic_filtering=True,id=69cd0729-f24f-4989-8fe9-18b1d56137d2,network=Network(f66b4945-a5d9-4ac0-988e-b6fca46a2bcb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69cd0729-f2')
Aug 17 17:08:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Deleting instance files /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba_del
Aug 17 17:08:15 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Deletion of /opt/stack/data/nova/instances/c4eef425-ad74-4af9-9ca7-50995c6d03ba_del complete
Aug 17 17:08:15 user nova-compute[72724]: INFO nova.compute.manager [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:08:15 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:16 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Error from libvirt while getting description of instance-0000002c: [Error Code 42] Domain not found: no domain with matching uuid 'c4eef425-ad74-4af9-9ca7-50995c6d03ba' (instance-0000002c): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c4eef425-ad74-4af9-9ca7-50995c6d03ba' (instance-0000002c)
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:17 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:08:17 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8718MB free_disk=25.241687774658203GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:08:17 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Took 1.18 seconds to deallocate network for instance.
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance c4eef425-ad74-4af9-9ca7-50995c6d03ba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 4fe643e3-5fbc-43b2-8268-d30572065a50 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] Acquiring lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] No waiting events found dispatching network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:08:17 user nova-compute[72724]: WARNING nova.compute.manager [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received unexpected event network-vif-plugged-69cd0729-f24f-4989-8fe9-18b1d56137d2 for instance with vm_state deleted and task_state None.
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-098f66e1-467f-4384-ae20-157798fe3c0d req-06c8eaf6-2b73-4b61-9f3b-b4589a3ed546 service nova] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Received event network-vif-deleted-69cd0729-f24f-4989-8fe9-18b1d56137d2 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.386s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:17 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Deleted allocations for instance c4eef425-ad74-4af9-9ca7-50995c6d03ba
Aug 17 17:08:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4caab343-63f2-4cb4-808b-9684fd6d475b tempest-AttachVolumeTestJSON-921709659 tempest-AttachVolumeTestJSON-921709659-project-member] Lock "c4eef425-ad74-4af9-9ca7-50995c6d03ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.749s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faOuzrwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:08:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:21 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cba053d-db18-4a15-bb1d-f7fe503fbb8c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:08:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d1f92-1b99-47bf-8d48-bd56f06501c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af] added
Aug 17 17:08:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b18b5e-6682-4d4b-b735-0a0d31c12f59]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.115s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacc5725-e88b-48fe-9b4f-095d0a758730]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v faOuzrwK {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v faOuzrwK" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[030299ee-33e0-44f2-9e2c-9c5d28f67652]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'faOuzrwK'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b96f96-c4c8-40c1-8e9e-2f6a92d38149]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9ada60-b376-4386-86d1-55d9a4cc6d68]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:08:22 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:08:22 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:22 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:08:22 user nova-compute[72724]: 
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e63f5-9f89-475d-86c8-bb893ff5cce4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260]
Aug 17 17:08:22 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260] successful.
Aug 17 17:08:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb355e0-6451-4fda-b104-c193dbe619c4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6c62f63-a420-4a97-94e6-76a846d9b4e8]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af (non-flash)
Aug 17 17:08:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af (non-flash)
Aug 17 17:08:22 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[947b739e-4605-4f33-b3ee-122c1e20ce8e]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:08:22 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faOuzrwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26564326665316165', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26564326665316165', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'flavor' on Instance uuid 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:08:23 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:23 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:08:23 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:08:23 user nova-compute[72724]:   <serial>eaaaa8f7-6b0c-4338-b8e6-614705c7c5af</serial>
Aug 17 17:08:23 user nova-compute[72724]: </disk>
Aug 17 17:08:23 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] No VIF found with MAC fa:16:3e:21:e0:98, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:08:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-9c9a616f-c280-498c-915f-a9fe62ef23fd tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.196s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:08:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:08:25 user nova-compute[72724]: INFO nova.compute.manager [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Detaching volume eaaaa8f7-6b0c-4338-b8e6-614705c7c5af
Aug 17 17:08:25 user nova-compute[72724]: INFO nova.virt.block_device [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Attempting to driver detach volume eaaaa8f7-6b0c-4338-b8e6-614705c7c5af from mountpoint /dev/vdb
Aug 17 17:08:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Attempting to detach device vdb from instance 4fe643e3-5fbc-43b2-8268-d30572065a50 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:08:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:08:25 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:25 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:08:25 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:08:25 user nova-compute[72724]:   <serial>eaaaa8f7-6b0c-4338-b8e6-614705c7c5af</serial>
Aug 17 17:08:25 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:08:25 user nova-compute[72724]: </disk>
Aug 17 17:08:25 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:08:25 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully detached device vdb from instance 4fe643e3-5fbc-43b2-8268-d30572065a50 from the persistent domain config.
Aug 17 17:08:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4fe643e3-5fbc-43b2-8268-d30572065a50 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:08:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:08:25 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:08:25 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:08:25 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:08:25 user nova-compute[72724]:   <serial>eaaaa8f7-6b0c-4338-b8e6-614705c7c5af</serial>
Aug 17 17:08:25 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:08:25 user nova-compute[72724]: </disk>
Aug 17 17:08:25 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:08:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292106.0271223, 4fe643e3-5fbc-43b2-8268-d30572065a50 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:08:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully detached device vdb from instance 4fe643e3-5fbc-43b2-8268-d30572065a50 from the live domain config.
Aug 17 17:08:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'faOuzrwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:08:26 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac020c4-a9bf-465a-8d0e-7c991c5f57cc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedfa3af-4b67-48b8-a70f-41d58651c930]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af (non-flash)
Aug 17 17:08:26 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af (non-flash)
Aug 17 17:08:26 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86eeada290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0feca3e-cb97-4140-b0dd-5aacd670bde3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fe7602-2930-4a50-8ff3-b6d7cb52a2a2]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a202e-5923-4823-99cb-71c00984152a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[424b724e-624f-46c8-9bf6-d85ef1e1fe7f]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cb5b0a-db0a-49de-951e-f35b4efaa944]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0f12b9-e7f4-48cc-bdb8-2cbf7a68a436]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260]
Aug 17 17:08:26 user nova-compute[72724]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af, portal: 172.16.0.220,3260] successful.
Aug 17 17:08:26 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eaaaa8f7-6b0c-4338-b8e6-614705c7c5af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272f4e6-3169-40f7-8d58-3ec4d15f1892]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] <== disconnect_volume: return (288ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:08:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'flavor' on Instance uuid 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:08:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-2123ca04-3159-46ab-9933-6c786cf5dd71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:08:30 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292095.7462418, c4eef425-ad74-4af9-9ca7-50995c6d03ba => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:08:30 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] VM Stopped (Lifecycle Event)
Aug 17 17:08:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-022dd42a-c6c1-4f85-b130-e0131d950f11 None None] [instance: c4eef425-ad74-4af9-9ca7-50995c6d03ba] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:08:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:08:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:08:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:08:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:08:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:08:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:09:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:09:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:09:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:09:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:09:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:11 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating instance_info_cache with network_info: [{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:09:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:09:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:09:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:09:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-changed-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Refreshing instance network info cache due to event network-changed-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] Acquiring lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] Acquired lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Refreshing network info cache for port d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:16 user nova-compute[72724]: INFO nova.compute.manager [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Terminating instance
Aug 17 17:09:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Instance destroyed successfully.
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.objects.instance [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'resources' on Instance uuid 4fe643e3-5fbc-43b2-8268-d30572065a50 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:06:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1803602912',display_name='tempest-TestStampPattern-server-1803602912',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1803602912',id=45,image_ref='e8f5a4aa-2c92-409a-ba37-51d9ce37ec83',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXYKcFPVGOL27nygfwan9oKUSyPDhwCmmd9xaTXKo6Oy+FXvrn7pGndZRwFepyZ++VdvRLoFLRME2rOGBGwWO9muZKyZr9tL1cDRihzIsoTmp0UWvUV5c2HXvZei+4eIg==',key_name='tempest-TestStampPattern-221982094',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:06:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec3b5e6a29fa4a889f7e14003ed3a453',ramdisk_id='',reservation_id='r-6gah0efh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f116cdf6-59ef-48fd-850e-8cb5e206ecc0',image_min_disk='1',image_min_ram='0',image_owner_id='ec3b5e6a29fa4a889f7e14003ed3a453',image_owner_project_name='tempest-TestStampPattern-249761649',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-249761649-project-member',image_user_id='020bea0e49c240dc81da4a3a9a05fe12',owner_project_name='tempest-TestStampPattern-249761649',owner_user_name='tempest-TestStampPattern-249761649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:06:25Z,user_data=None,user_id='020bea0e49c240dc81da4a3a9a05fe12',uuid=4fe643e3-5fbc-43b2-8268-d30572065a50,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converting VIF {"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG os_vif [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd24bc58f-9b, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:09:17 user nova-compute[72724]: INFO os_vif [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:e0:98,bridge_name='br-int',has_traffic_filtering=True,id=d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd24bc58f-9b')
Aug 17 17:09:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Deleting instance files /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50_del
Aug 17 17:09:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Deletion of /opt/stack/data/nova/instances/4fe643e3-5fbc-43b2-8268-d30572065a50_del complete
Aug 17 17:09:17 user nova-compute[72724]: INFO nova.compute.manager [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-5292a719-b2a3-4c5f-87a3-5e2f70a367ff req-ff45156b-5b84-48aa-a82d-5371de9351df service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-vif-unplugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5292a719-b2a3-4c5f-87a3-5e2f70a367ff req-ff45156b-5b84-48aa-a82d-5371de9351df service nova] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5292a719-b2a3-4c5f-87a3-5e2f70a367ff req-ff45156b-5b84-48aa-a82d-5371de9351df service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-5292a719-b2a3-4c5f-87a3-5e2f70a367ff req-ff45156b-5b84-48aa-a82d-5371de9351df service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-5292a719-b2a3-4c5f-87a3-5e2f70a367ff req-ff45156b-5b84-48aa-a82d-5371de9351df service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] No waiting events found dispatching network-vif-unplugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-5292a719-b2a3-4c5f-87a3-5e2f70a367ff req-ff45156b-5b84-48aa-a82d-5371de9351df service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-vif-unplugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updated VIF entry in instance network info cache for port d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating instance_info_cache with network_info: [{"id": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "address": "fa:16:3e:21:e0:98", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd24bc58f-9b", "ovs_interfaceid": "d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-03375da0-81ab-4123-b215-e319fea76d00 req-ba96416d-ea0d-4c2b-96c2-aacb4a208783 service nova] Releasing lock "refresh_cache-4fe643e3-5fbc-43b2-8268-d30572065a50" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:17 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Took 0.55 seconds to deallocate network for instance.
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.183s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:17 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Deleted allocations for instance 4fe643e3-5fbc-43b2-8268-d30572065a50
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:09:17 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-5e9ca5e0-85ab-4ade-999c-267e15f0ba71 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.834s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.manager [req-d964d001-c057-421a-8284-d5abfbcbe8b1 req-5cdd1035-39d0-4864-bcaa-59e594fc4bb3 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-vif-deleted-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:09:18 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:09:18 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8785MB free_disk=25.26962661743164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:09:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-065a451d-aa9f-4b3e-baec-dc87a7b0298f req-32bffa4d-d25b-421d-9325-182e454eae01 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received event network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:09:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-065a451d-aa9f-4b3e-baec-dc87a7b0298f req-32bffa4d-d25b-421d-9325-182e454eae01 service nova] Acquiring lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-065a451d-aa9f-4b3e-baec-dc87a7b0298f req-32bffa4d-d25b-421d-9325-182e454eae01 service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-065a451d-aa9f-4b3e-baec-dc87a7b0298f req-32bffa4d-d25b-421d-9325-182e454eae01 service nova] Lock "4fe643e3-5fbc-43b2-8268-d30572065a50-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:19 user nova-compute[72724]: DEBUG nova.compute.manager [req-065a451d-aa9f-4b3e-baec-dc87a7b0298f req-32bffa4d-d25b-421d-9325-182e454eae01 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] No waiting events found dispatching network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:09:19 user nova-compute[72724]: WARNING nova.compute.manager [req-065a451d-aa9f-4b3e-baec-dc87a7b0298f req-32bffa4d-d25b-421d-9325-182e454eae01 service nova] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Received unexpected event network-vif-plugged-d24bc58f-9bf3-4b6e-88bf-9a6f454d2d43 for instance with vm_state deleted and task_state None.
Aug 17 17:09:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292157.0273097, 4fe643e3-5fbc-43b2-8268-d30572065a50 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:09:32 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] VM Stopped (Lifecycle Event)
Aug 17 17:09:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f9819685-46ee-4f83-8efd-3f6fe37abd16 None None] [instance: 4fe643e3-5fbc-43b2-8268-d30572065a50] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:09:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:09:55 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:09:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 17:09:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:09:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:09:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:09:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:10:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:10:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:10:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:10:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:10:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:15 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:10:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:10:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:10:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:10:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:10:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:10:19 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:10:19 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.365474700927734GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:10:19 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:20 user nova-compute[72724]: INFO nova.compute.manager [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Terminating instance
Aug 17 17:10:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-changed-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Refreshing instance network info cache due to event network-changed-33340ff4-9784-4089-ae55-33222223e2dd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] Acquiring lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] Acquired lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG nova.network.neutron [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Refreshing network info cache for port 33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-3b45d234-e516-4a23-8946-43eafd06a42d req-0bc76a61-d645-4ffe-89b5-73983629bbaa service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-vif-unplugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3b45d234-e516-4a23-8946-43eafd06a42d req-0bc76a61-d645-4ffe-89b5-73983629bbaa service nova] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3b45d234-e516-4a23-8946-43eafd06a42d req-0bc76a61-d645-4ffe-89b5-73983629bbaa service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3b45d234-e516-4a23-8946-43eafd06a42d req-0bc76a61-d645-4ffe-89b5-73983629bbaa service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-3b45d234-e516-4a23-8946-43eafd06a42d req-0bc76a61-d645-4ffe-89b5-73983629bbaa service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] No waiting events found dispatching network-vif-unplugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.compute.manager [req-3b45d234-e516-4a23-8946-43eafd06a42d req-0bc76a61-d645-4ffe-89b5-73983629bbaa service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-vif-unplugged-33340ff4-9784-4089-ae55-33222223e2dd for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updated VIF entry in instance network info cache for port 33340ff4-9784-4089-ae55-33222223e2dd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [{"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-47ea7269-e35f-4692-9c42-a0bb916d00c1 req-f4c919f4-8d01-48d4-a043-f574de95148e service nova] Releasing lock "refresh_cache-f116cdf6-59ef-48fd-850e-8cb5e206ecc0" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:10:21 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Instance destroyed successfully.
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.objects.instance [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lazy-loading 'resources' on Instance uuid f116cdf6-59ef-48fd-850e-8cb5e206ecc0 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:03:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1475085965',display_name='tempest-TestStampPattern-server-1475085965',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1475085965',id=43,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCXYKcFPVGOL27nygfwan9oKUSyPDhwCmmd9xaTXKo6Oy+FXvrn7pGndZRwFepyZ++VdvRLoFLRME2rOGBGwWO9muZKyZr9tL1cDRihzIsoTmp0UWvUV5c2HXvZei+4eIg==',key_name='tempest-TestStampPattern-221982094',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:03:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec3b5e6a29fa4a889f7e14003ed3a453',ramdisk_id='',reservation_id='r-l3t7bv7l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-249761649',owner_user_name='tempest-TestStampPattern-249761649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:06:16Z,user_data=None,user_id='020bea0e49c240dc81da4a3a9a05fe12',uuid=f116cdf6-59ef-48fd-850e-8cb5e206ecc0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converting VIF {"id": "33340ff4-9784-4089-ae55-33222223e2dd", "address": "fa:16:3e:a9:16:1f", "network": {"id": "8819016c-c1eb-4fb8-82e1-78444a350e6e", "bridge": "br-int", "label": "tempest-TestStampPattern-310805574-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec3b5e6a29fa4a889f7e14003ed3a453", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33340ff4-97", "ovs_interfaceid": "33340ff4-9784-4089-ae55-33222223e2dd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG os_vif [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33340ff4-97, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:21 user nova-compute[72724]: INFO os_vif [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:16:1f,bridge_name='br-int',has_traffic_filtering=True,id=33340ff4-9784-4089-ae55-33222223e2dd,network=Network(8819016c-c1eb-4fb8-82e1-78444a350e6e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33340ff4-97')
Aug 17 17:10:21 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Deleting instance files /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0_del
Aug 17 17:10:21 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Deletion of /opt/stack/data/nova/instances/f116cdf6-59ef-48fd-850e-8cb5e206ecc0_del complete
Aug 17 17:10:21 user nova-compute[72724]: INFO nova.compute.manager [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 17 17:10:21 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:10:21 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:10:22 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:10:22 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Took 0.94 seconds to deallocate network for instance.
Aug 17 17:10:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:22 user nova-compute[72724]: DEBUG nova.compute.manager [req-249492c9-5e1f-4e0e-be8e-a7631a51d59a req-a8a5ac45-c271-4f06-ab1a-ec4e0fbda5d4 service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-vif-deleted-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:10:22 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:10:22 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:10:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:22 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Deleted allocations for instance f116cdf6-59ef-48fd-850e-8cb5e206ecc0
Aug 17 17:10:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-055700d5-cf8b-4235-b2f0-78b70d1d9fb8 tempest-TestStampPattern-249761649 tempest-TestStampPattern-249761649-project-member] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbcda850-6f34-4216-ae4d-094b4da3e0ce req-33db62de-7e81-47e8-9cd9-585b4f2334aa service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received event network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:10:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bbcda850-6f34-4216-ae4d-094b4da3e0ce req-33db62de-7e81-47e8-9cd9-585b4f2334aa service nova] Acquiring lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:10:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bbcda850-6f34-4216-ae4d-094b4da3e0ce req-33db62de-7e81-47e8-9cd9-585b4f2334aa service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:10:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bbcda850-6f34-4216-ae4d-094b4da3e0ce req-33db62de-7e81-47e8-9cd9-585b4f2334aa service nova] Lock "f116cdf6-59ef-48fd-850e-8cb5e206ecc0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:10:23 user nova-compute[72724]: DEBUG nova.compute.manager [req-bbcda850-6f34-4216-ae4d-094b4da3e0ce req-33db62de-7e81-47e8-9cd9-585b4f2334aa service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] No waiting events found dispatching network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:10:23 user nova-compute[72724]: WARNING nova.compute.manager [req-bbcda850-6f34-4216-ae4d-094b4da3e0ce req-33db62de-7e81-47e8-9cd9-585b4f2334aa service nova] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Received unexpected event network-vif-plugged-33340ff4-9784-4089-ae55-33222223e2dd for instance with vm_state deleted and task_state None.
Aug 17 17:10:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292221.6707733, f116cdf6-59ef-48fd-850e-8cb5e206ecc0 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:10:36 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] VM Stopped (Lifecycle Event)
Aug 17 17:10:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-b453c0ce-2916-4cbf-845e-8c4011fbf826 None None] [instance: f116cdf6-59ef-48fd-850e-8cb5e206ecc0] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:10:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:10:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:10:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:10:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:10:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:10:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:11:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:11:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:11:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:11:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:11:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:11:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:11:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:11:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:11:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:11:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:11:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:15 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:11:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:11:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:11:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:11:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:11:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=25.391353607177734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:44 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:11:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:44 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:11:44 user nova-compute[72724]: INFO nova.compute.claims [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Claim successful on node user
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.193s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:11:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.policy [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'adfe8ff94fee434b8df4b38516a94856', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0d0783bcb5044f7866197a70849f0d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:11:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Creating image(s)
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "/opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "/opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.213s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk 1073741824" returned: 0 in 0.050s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 17:11:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Successfully created port: 1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Cannot resize image /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'migration_context' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Ensure instance console log exists: /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Successfully updated port: 1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-changed-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Refreshing instance network info cache due to event network-changed-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:11:46 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Instance network_info: |[{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Refreshing network info cache for port 1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Start _get_guest_xml network_info=[{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:11:47 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:11:47 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-393029292',display_name='tempest-SnapshotDataIntegrityTests-server-393029292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-393029292',id=46,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjbbFxV8xRhWT4fIwdXsZ+/BzX7e901Yf3nObtGwz+b+k6E3bkRNGqgPZXxK2j14G0Xitv1U0hdO8uOdH81dx0qUOzfCd2suBB6kYOxQSdlJAAQl4oGIE1AzDKyFwvhpA==',key_name='tempest-keypair-133649445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d0783bcb5044f7866197a70849f0d3',ramdisk_id='',reservation_id='r-ulbc1vl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-447747392',owner_user_name='tempest-SnapshotDataIntegrityTests-447747392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adfe8ff94fee434b8df4b38516a94856',uuid=e4d3bac6-de98-4f05-81b0-9e5882d95711,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Converting VIF {"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'pci_devices' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:11:47 user nova-compute[72724]:   <uuid>e4d3bac6-de98-4f05-81b0-9e5882d95711</uuid>
Aug 17 17:11:47 user nova-compute[72724]:   <name>instance-0000002e</name>
Aug 17 17:11:47 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:11:47 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:11:47 user nova-compute[72724]:   <metadata>
Aug 17 17:11:47 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:11:47 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:11:47 user nova-compute[72724]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-393029292</nova:name>
Aug 17 17:11:47 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:11:47</nova:creationTime>
Aug 17 17:11:47 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:11:47 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:11:47 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:11:47 user nova-compute[72724]:       <nova:owner>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:user uuid="adfe8ff94fee434b8df4b38516a94856">tempest-SnapshotDataIntegrityTests-447747392-project-member</nova:user>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:project uuid="e0d0783bcb5044f7866197a70849f0d3">tempest-SnapshotDataIntegrityTests-447747392</nova:project>
Aug 17 17:11:47 user nova-compute[72724]:       </nova:owner>
Aug 17 17:11:47 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 17:11:47 user nova-compute[72724]:       <nova:ports>
Aug 17 17:11:47 user nova-compute[72724]:         <nova:port uuid="1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce">
Aug 17 17:11:47 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 17:11:47 user nova-compute[72724]:         </nova:port>
Aug 17 17:11:47 user nova-compute[72724]:       </nova:ports>
Aug 17 17:11:47 user nova-compute[72724]:     </nova:instance>
Aug 17 17:11:47 user nova-compute[72724]:   </metadata>
Aug 17 17:11:47 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:11:47 user nova-compute[72724]:     <system>
Aug 17 17:11:47 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:11:47 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:11:47 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:11:47 user nova-compute[72724]:       <entry name="serial">e4d3bac6-de98-4f05-81b0-9e5882d95711</entry>
Aug 17 17:11:47 user nova-compute[72724]:       <entry name="uuid">e4d3bac6-de98-4f05-81b0-9e5882d95711</entry>
Aug 17 17:11:47 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:11:47 user nova-compute[72724]:     </system>
Aug 17 17:11:47 user nova-compute[72724]:   </sysinfo>
Aug 17 17:11:47 user nova-compute[72724]:   <os>
Aug 17 17:11:47 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:11:47 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:11:47 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:11:47 user nova-compute[72724]:   </os>
Aug 17 17:11:47 user nova-compute[72724]:   <features>
Aug 17 17:11:47 user nova-compute[72724]:     <acpi/>
Aug 17 17:11:47 user nova-compute[72724]:     <apic/>
Aug 17 17:11:47 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:11:47 user nova-compute[72724]:   </features>
Aug 17 17:11:47 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:11:47 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:11:47 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:11:47 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:11:47 user nova-compute[72724]:   </clock>
Aug 17 17:11:47 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:11:47 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:11:47 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:11:47 user nova-compute[72724]:   </cpu>
Aug 17 17:11:47 user nova-compute[72724]:   <devices>
Aug 17 17:11:47 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 17:11:47 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 17:11:47 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk"/>
Aug 17 17:11:47 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:11:47 user nova-compute[72724]:     </disk>
Aug 17 17:11:47 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:11:47 user nova-compute[72724]:       <mac address="fa:16:3e:23:f9:19"/>
Aug 17 17:11:47 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:11:47 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:11:47 user nova-compute[72724]:       <target dev="tap1e45a9c5-73"/>
Aug 17 17:11:47 user nova-compute[72724]:     </interface>
Aug 17 17:11:47 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:11:47 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/console.log" append="off"/>
Aug 17 17:11:47 user nova-compute[72724]:     </serial>
Aug 17 17:11:47 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:11:47 user nova-compute[72724]:     <video>
Aug 17 17:11:47 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:11:47 user nova-compute[72724]:     </video>
Aug 17 17:11:47 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:11:47 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:11:47 user nova-compute[72724]:     </rng>
Aug 17 17:11:47 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:11:47 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:11:47 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:11:47 user nova-compute[72724]:     </memballoon>
Aug 17 17:11:47 user nova-compute[72724]:   </devices>
Aug 17 17:11:47 user nova-compute[72724]: </domain>
Aug 17 17:11:47 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-393029292',display_name='tempest-SnapshotDataIntegrityTests-server-393029292',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-393029292',id=46,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjbbFxV8xRhWT4fIwdXsZ+/BzX7e901Yf3nObtGwz+b+k6E3bkRNGqgPZXxK2j14G0Xitv1U0hdO8uOdH81dx0qUOzfCd2suBB6kYOxQSdlJAAQl4oGIE1AzDKyFwvhpA==',key_name='tempest-keypair-133649445',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e0d0783bcb5044f7866197a70849f0d3',ramdisk_id='',reservation_id='r-ulbc1vl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-447747392',owner_user_name='tempest-SnapshotDataIntegrityTests-447747392-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:11:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adfe8ff94fee434b8df4b38516a94856',uuid=e4d3bac6-de98-4f05-81b0-9e5882d95711,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Converting VIF {"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG os_vif [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e45a9c5-73, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1e45a9c5-73, col_values=(('external_ids', {'iface-id': '1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:f9:19', 'vm-uuid': 'e4d3bac6-de98-4f05-81b0-9e5882d95711'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:47 user nova-compute[72724]: INFO os_vif [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73')
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No VIF found with MAC fa:16:3e:23:f9:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated VIF entry in instance network info cache for port 1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:11:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b25131e1-a8dd-425f-a7a8-0ce9fc8b42c1 req-4f5713dc-116c-413e-a037-1662fe5fd1d8 service nova] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-d32da4c9-5f72-4199-b202-09a70f8e02f2 req-63abd18b-fe4f-4d51-967c-d8587d56db22 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d32da4c9-5f72-4199-b202-09a70f8e02f2 req-63abd18b-fe4f-4d51-967c-d8587d56db22 service nova] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d32da4c9-5f72-4199-b202-09a70f8e02f2 req-63abd18b-fe4f-4d51-967c-d8587d56db22 service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d32da4c9-5f72-4199-b202-09a70f8e02f2 req-63abd18b-fe4f-4d51-967c-d8587d56db22 service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:48 user nova-compute[72724]: DEBUG nova.compute.manager [req-d32da4c9-5f72-4199-b202-09a70f8e02f2 req-63abd18b-fe4f-4d51-967c-d8587d56db22 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] No waiting events found dispatching network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:11:48 user nova-compute[72724]: WARNING nova.compute.manager [req-d32da4c9-5f72-4199-b202-09a70f8e02f2 req-63abd18b-fe4f-4d51-967c-d8587d56db22 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received unexpected event network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce for instance with vm_state building and task_state spawning.
Aug 17 17:11:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:50 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292310.9712722, e4d3bac6-de98-4f05-81b0-9e5882d95711 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:11:50 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] VM Resumed (Lifecycle Event)
Aug 17 17:11:50 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:11:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:11:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Instance spawned successfully.
Aug 17 17:11:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-a97d5287-fdfa-4e98-9de6-6cdd7b0ac651 req-ffcf5472-4165-47d6-b2ef-e81872374b6f service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a97d5287-fdfa-4e98-9de6-6cdd7b0ac651 req-ffcf5472-4165-47d6-b2ef-e81872374b6f service nova] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a97d5287-fdfa-4e98-9de6-6cdd7b0ac651 req-ffcf5472-4165-47d6-b2ef-e81872374b6f service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-a97d5287-fdfa-4e98-9de6-6cdd7b0ac651 req-ffcf5472-4165-47d6-b2ef-e81872374b6f service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-a97d5287-fdfa-4e98-9de6-6cdd7b0ac651 req-ffcf5472-4165-47d6-b2ef-e81872374b6f service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] No waiting events found dispatching network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:11:51 user nova-compute[72724]: WARNING nova.compute.manager [req-a97d5287-fdfa-4e98-9de6-6cdd7b0ac651 req-ffcf5472-4165-47d6-b2ef-e81872374b6f service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received unexpected event network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce for instance with vm_state building and task_state spawning.
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:11:51 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292310.9756837, e4d3bac6-de98-4f05-81b0-9e5882d95711 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:11:51 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] VM Started (Lifecycle Event)
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:11:51 user nova-compute[72724]: INFO nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Took 5.80 seconds to spawn the instance on the hypervisor.
Aug 17 17:11:51 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:11:51 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:11:51 user nova-compute[72724]: INFO nova.compute.manager [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Took 6.32 seconds to build instance.
Aug 17 17:11:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d2636ea8-b8b4-4ded-860d-a2eeaa65998a tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.409s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:11:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:11:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:12:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:12:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:12:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:12:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:12:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:12:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:12:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:12:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:12:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:12:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:12:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:12:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:12:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8736MB free_disk=25.35211181640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:12:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:12:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:12:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:12:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:12:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:12:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:12:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:12:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:12:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:12:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:12:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:07 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:13:08 user nova-compute[72724]: INFO nova.compute.claims [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Claim successful on node user
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.network.neutron [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:13:08 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:13:08 user nova-compute[72724]: INFO nova.virt.block_device [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Booting with volume snapshot 4314927d-a6d6-48b2-854e-1bafcc2160e8 at /dev/vda
Aug 17 17:13:08 user nova-compute[72724]: DEBUG nova.policy [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e503ef7b08034c8ea4135912c91d9c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c38413cbee44af48869f91b661b1333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:13:09 user nova-compute[72724]: DEBUG nova.network.neutron [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Successfully created port: e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:13:09 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Successfully updated port: e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "refresh_cache-7ebd6306-e847-4926-b19d-08bf7fdc9170" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquired lock "refresh_cache-7ebd6306-e847-4926-b19d-08bf7fdc9170" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-changed-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.compute.manager [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Refreshing instance network info cache due to event network-changed-e5bedfb3-fd37-49cf-8248-4678fc59ecce. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] Acquiring lock "refresh_cache-7ebd6306-e847-4926-b19d-08bf7fdc9170" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Updating instance_info_cache with network_info: [{"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Releasing lock "refresh_cache-7ebd6306-e847-4926-b19d-08bf7fdc9170" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Instance network_info: |[{"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] Acquired lock "refresh_cache-7ebd6306-e847-4926-b19d-08bf7fdc9170" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:13:10 user nova-compute[72724]: DEBUG nova.network.neutron [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Refreshing network info cache for port e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:13:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Updated VIF entry in instance network info cache for port e5bedfb3-fd37-49cf-8248-4678fc59ecce. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:13:11 user nova-compute[72724]: DEBUG nova.network.neutron [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Updating instance_info_cache with network_info: [{"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:13:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8b7d1b94-d6b7-4427-846e-5e0242fc118b req-4fea3767-380a-4808-9bba-f6fa2d43fd22 service nova] Releasing lock "refresh_cache-7ebd6306-e847-4926-b19d-08bf7fdc9170" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:13:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG os_brick.utils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fcb447e-0f7a-4b85-b7c7-9b2fbb564f4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daf3435-aed9-4a49-97d9-6277a9c4e28c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ef8702-4fde-4097-bf78-c232a74ba1c7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac37220-2641-47bc-b866-a7ba5df2327e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:13:14 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2934ea2a-626e-44c8-be24-87d7197b2828]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG os_brick.utils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Updating existing volume attachment record: 59212c56-d302-414b-b811-b854abeeeac3 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Skipping network cache update for instance because it is Building. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:13:14 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:13:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:13:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:13:15 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:13:15 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:13:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:13:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8783MB free_disk=25.349594116210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7ebd6306-e847-4926-b19d-08bf7fdc9170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:13:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:13:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:13:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:13:24 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Creating image(s)
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Ensure instance console log exists: /opt/stack/data/nova/instances/7ebd6306-e847-4926-b19d-08bf7fdc9170/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Start _get_guest_xml network_info=[{"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '59212c56-d302-414b-b811-b854abeeeac3', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvlMIgpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7ebd6306-e847-4926-b19d-08bf7fdc9170', 'attached_at': '', 'detached_at': '', 'volume_id': '3fb16703-0bd0-433c-bd2d-4f02a28d2076', 'serial': '3fb16703-0bd0-433c-bd2d-4f02a28d2076'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:13:24 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:13:24 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvlMIgpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:13:24 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:13:24 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:13:24 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff6ef8a-78e3-4f0d-ab09-e639581965f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:13:24 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a85557-07a4-4f76-813a-6abec66d1ec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076] added
Aug 17 17:13:24 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d05c5fd-7735-4686-ba55-b412881465db]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1809f70-4f67-4866-91ae-f296b4eddd3e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvlMIgpk {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvlMIgpk" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2a9d63-720b-4f45-be98-ea293bd663de]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvlMIgpk'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88b77da-2076-417e-9a8f-a243b86813e3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b100334-e4ca-4aef-aa8a-0f5481005a99]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:13:24 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:13:24 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:13:24 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:13:24 user nova-compute[72724]: 
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0203ff04-828d-447f-8238-49992c258cc4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260]
Aug 17 17:13:24 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260] successful.
Aug 17 17:13:24 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[356176e6-cd18-4309-8c42-6ec2b3ea8113]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead0e8b2-d0a3-4614-ab9b-e086f1289c79]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:13:24 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:13:24 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0d308e-3712-424f-9a5e-1e89ebdb1033]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:24 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvlMIgpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26535303535366236', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535303535366236', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:13:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423545135',display_name='tempest-TestVolumeBootPattern-server-1423545135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423545135',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-bhg46m0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:13:08Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=7ebd6306-e847-4926-b19d-08bf7fdc9170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:13:25 user nova-compute[72724]: DEBUG nova.objects.instance [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ebd6306-e847-4926-b19d-08bf7fdc9170 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:13:26 user nova-compute[72724]:   <uuid>7ebd6306-e847-4926-b19d-08bf7fdc9170</uuid>
Aug 17 17:13:26 user nova-compute[72724]:   <name>instance-0000002f</name>
Aug 17 17:13:26 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:13:26 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:13:26 user nova-compute[72724]:   <metadata>
Aug 17 17:13:26 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:13:26 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:13:26 user nova-compute[72724]:       <nova:name>tempest-TestVolumeBootPattern-server-1423545135</nova:name>
Aug 17 17:13:26 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:13:24</nova:creationTime>
Aug 17 17:13:26 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:13:26 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:13:26 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:13:26 user nova-compute[72724]:       <nova:owner>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:user uuid="e503ef7b08034c8ea4135912c91d9c0f">tempest-TestVolumeBootPattern-924115856-project-member</nova:user>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:project uuid="0c38413cbee44af48869f91b661b1333">tempest-TestVolumeBootPattern-924115856</nova:project>
Aug 17 17:13:26 user nova-compute[72724]:       </nova:owner>
Aug 17 17:13:26 user nova-compute[72724]:       <nova:ports>
Aug 17 17:13:26 user nova-compute[72724]:         <nova:port uuid="e5bedfb3-fd37-49cf-8248-4678fc59ecce">
Aug 17 17:13:26 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 17 17:13:26 user nova-compute[72724]:         </nova:port>
Aug 17 17:13:26 user nova-compute[72724]:       </nova:ports>
Aug 17 17:13:26 user nova-compute[72724]:     </nova:instance>
Aug 17 17:13:26 user nova-compute[72724]:   </metadata>
Aug 17 17:13:26 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:13:26 user nova-compute[72724]:     <system>
Aug 17 17:13:26 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:13:26 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:13:26 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:13:26 user nova-compute[72724]:       <entry name="serial">7ebd6306-e847-4926-b19d-08bf7fdc9170</entry>
Aug 17 17:13:26 user nova-compute[72724]:       <entry name="uuid">7ebd6306-e847-4926-b19d-08bf7fdc9170</entry>
Aug 17 17:13:26 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:13:26 user nova-compute[72724]:     </system>
Aug 17 17:13:26 user nova-compute[72724]:   </sysinfo>
Aug 17 17:13:26 user nova-compute[72724]:   <os>
Aug 17 17:13:26 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:13:26 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:13:26 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:13:26 user nova-compute[72724]:   </os>
Aug 17 17:13:26 user nova-compute[72724]:   <features>
Aug 17 17:13:26 user nova-compute[72724]:     <acpi/>
Aug 17 17:13:26 user nova-compute[72724]:     <apic/>
Aug 17 17:13:26 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:13:26 user nova-compute[72724]:   </features>
Aug 17 17:13:26 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:13:26 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:13:26 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:13:26 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:13:26 user nova-compute[72724]:   </clock>
Aug 17 17:13:26 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:13:26 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:13:26 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:13:26 user nova-compute[72724]:   </cpu>
Aug 17 17:13:26 user nova-compute[72724]:   <devices>
Aug 17 17:13:26 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 17:13:26 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:13:26 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 17:13:26 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:13:26 user nova-compute[72724]:       <serial>3fb16703-0bd0-433c-bd2d-4f02a28d2076</serial>
Aug 17 17:13:26 user nova-compute[72724]:     </disk>
Aug 17 17:13:26 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:13:26 user nova-compute[72724]:       <mac address="fa:16:3e:b8:20:92"/>
Aug 17 17:13:26 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:13:26 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:13:26 user nova-compute[72724]:       <target dev="tape5bedfb3-fd"/>
Aug 17 17:13:26 user nova-compute[72724]:     </interface>
Aug 17 17:13:26 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:13:26 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/7ebd6306-e847-4926-b19d-08bf7fdc9170/console.log" append="off"/>
Aug 17 17:13:26 user nova-compute[72724]:     </serial>
Aug 17 17:13:26 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:13:26 user nova-compute[72724]:     <video>
Aug 17 17:13:26 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:13:26 user nova-compute[72724]:     </video>
Aug 17 17:13:26 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:13:26 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:13:26 user nova-compute[72724]:     </rng>
Aug 17 17:13:26 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:13:26 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:13:26 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:13:26 user nova-compute[72724]:     </memballoon>
Aug 17 17:13:26 user nova-compute[72724]:   </devices>
Aug 17 17:13:26 user nova-compute[72724]: </domain>
Aug 17 17:13:26 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:13:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423545135',display_name='tempest-TestVolumeBootPattern-server-1423545135',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423545135',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-bhg46m0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:13:08Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=7ebd6306-e847-4926-b19d-08bf7fdc9170,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG os_vif [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5bedfb3-fd, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape5bedfb3-fd, col_values=(('external_ids', {'iface-id': 'e5bedfb3-fd37-49cf-8248-4678fc59ecce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:20:92', 'vm-uuid': '7ebd6306-e847-4926-b19d-08bf7fdc9170'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:26 user nova-compute[72724]: INFO os_vif [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd')
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No VIF found with MAC fa:16:3e:b8:20:92, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-35cef389-9137-40be-b09f-747f3fc1ac2a req-a2259cf9-ba4d-483d-9fb8-ae2812dba4d2 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35cef389-9137-40be-b09f-747f3fc1ac2a req-a2259cf9-ba4d-483d-9fb8-ae2812dba4d2 service nova] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35cef389-9137-40be-b09f-747f3fc1ac2a req-a2259cf9-ba4d-483d-9fb8-ae2812dba4d2 service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-35cef389-9137-40be-b09f-747f3fc1ac2a req-a2259cf9-ba4d-483d-9fb8-ae2812dba4d2 service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-35cef389-9137-40be-b09f-747f3fc1ac2a req-a2259cf9-ba4d-483d-9fb8-ae2812dba4d2 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] No waiting events found dispatching network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:13:27 user nova-compute[72724]: WARNING nova.compute.manager [req-35cef389-9137-40be-b09f-747f3fc1ac2a req-a2259cf9-ba4d-483d-9fb8-ae2812dba4d2 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received unexpected event network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce for instance with vm_state building and task_state spawning.
Aug 17 17:13:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292409.3868659, 7ebd6306-e847-4926-b19d-08bf7fdc9170 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] VM Resumed (Lifecycle Event)
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Instance spawned successfully.
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292409.388508, 7ebd6306-e847-4926-b19d-08bf7fdc9170 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] VM Started (Lifecycle Event)
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Took 4.89 seconds to spawn the instance on the hypervisor.
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:13:29 user nova-compute[72724]: INFO nova.compute.manager [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Took 21.61 seconds to build instance.
Aug 17 17:13:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-a474a509-4c88-43e4-bacf-59aa5e2fd843 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.694s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-4596e5bd-faa0-4130-9938-69aaf9a6c9b9 req-2753fbd9-d0d6-49d4-af25-4cf47f5386ce service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4596e5bd-faa0-4130-9938-69aaf9a6c9b9 req-2753fbd9-d0d6-49d4-af25-4cf47f5386ce service nova] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4596e5bd-faa0-4130-9938-69aaf9a6c9b9 req-2753fbd9-d0d6-49d4-af25-4cf47f5386ce service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4596e5bd-faa0-4130-9938-69aaf9a6c9b9 req-2753fbd9-d0d6-49d4-af25-4cf47f5386ce service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-4596e5bd-faa0-4130-9938-69aaf9a6c9b9 req-2753fbd9-d0d6-49d4-af25-4cf47f5386ce service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] No waiting events found dispatching network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:13:29 user nova-compute[72724]: WARNING nova.compute.manager [req-4596e5bd-faa0-4130-9938-69aaf9a6c9b9 req-2753fbd9-d0d6-49d4-af25-4cf47f5386ce service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received unexpected event network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce for instance with vm_state active and task_state None.
Aug 17 17:13:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:13:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:13:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:13:35 user nova-compute[72724]: DEBUG nova.compute.manager [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-changed-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:13:35 user nova-compute[72724]: DEBUG nova.compute.manager [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Refreshing instance network info cache due to event network-changed-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:13:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:13:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:13:35 user nova-compute[72724]: DEBUG nova.network.neutron [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Refreshing network info cache for port 1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:13:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated VIF entry in instance network info cache for port 1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:13:36 user nova-compute[72724]: DEBUG nova.network.neutron [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:13:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e2757e7c-7379-4466-8f76-18384a9d9601 req-4f6015da-02c8-4824-8f27-f61c4daeeffb service nova] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:13:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:13:41 user nova-compute[72724]: INFO nova.compute.manager [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attaching volume 143a533d-fb45-4c5b-a39c-d1d518e141cf to /dev/vdb
Aug 17 17:13:41 user nova-compute[72724]: DEBUG os_brick.utils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2572b9e9-8925-4458-a111-3bce15ce0306]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a158b2bf-61e3-4ca3-821b-7a9b9b7787c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84706d2-895f-4a73-b8c4-8f880cb57e9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[074cc169-24ce-40de-9996-6b8b99e3d869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:13:41 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:13:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d99aca9-1777-492f-9321-a9457c13ee2a]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG os_brick.utils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:13:41 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating existing volume attachment record: cba32516-adfd-469a-8e89-fd91cb44aa79 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:13:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'auRCKtpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:13:51 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:13:51 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:13:51 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e564376f-f657-4163-8e04-e0e7f23ac7e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:13:51 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bf41d9-1ae1-4a62-8a46-83b5251d6886]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf] added
Aug 17 17:13:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6982a192-eb50-48fa-882a-fd475605cb73]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[346cf692-0d60-4f0d-8376-8269d9b7e3e8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v auRCKtpE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v auRCKtpE" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[84801320-771b-4048-a288-3eef720deabc]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'auRCKtpE'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a46a100-ae86-4ebc-9ac2-2df163ce47b7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dbd2a8d-84d4-4fd7-9523-cf23fde8ec2d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:13:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:13:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df07136-ec2d-42a7-a062-a00dcabb99fb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260]
Aug 17 17:13:51 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260] successful.
Aug 17 17:13:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2662a762-7015-4cee-bd33-ce3c058a11b9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bb6140-bd76-4700-b90a-6cbbe9bc80c4]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:13:51 user nova-compute[72724]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf (non-flash)
Aug 17 17:13:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:13:51 user nova-compute[72724]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf (non-flash)
Aug 17 17:13:51 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f6b814-e2de-4e51-9b0c-39b09845b9dc]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:13:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'auRCKtpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:13:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:13:52 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26333613233656633', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:13:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333613233656633', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:13:52 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:13:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:13:52 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:13:52 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:13:52 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:13:52 user nova-compute[72724]:   <serial>143a533d-fb45-4c5b-a39c-d1d518e141cf</serial>
Aug 17 17:13:52 user nova-compute[72724]: </disk>
Aug 17 17:13:52 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:13:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:13:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:13:53 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No VIF found with MAC fa:16:3e:23:f9:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:13:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f0b1c7c7-3a7c-4cee-8199-21dc0244b1f8 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.125s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:13:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:13:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:14:16 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:14:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:17 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:14:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:14:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:14:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:14:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:14:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:14:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.347412109375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 7ebd6306-e847-4926-b19d-08bf7fdc9170 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:14:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:14:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:14:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:14:22 user nova-compute[72724]: INFO nova.compute.manager [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Detaching volume 143a533d-fb45-4c5b-a39c-d1d518e141cf
Aug 17 17:14:23 user nova-compute[72724]: INFO nova.virt.block_device [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attempting to driver detach volume 143a533d-fb45-4c5b-a39c-d1d518e141cf from mountpoint /dev/vdb
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Attempting to detach device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:14:23 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:14:23 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:14:23 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:14:23 user nova-compute[72724]:   <serial>143a533d-fb45-4c5b-a39c-d1d518e141cf</serial>
Aug 17 17:14:23 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:14:23 user nova-compute[72724]: </disk>
Aug 17 17:14:23 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:14:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config.
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:14:23 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:14:23 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:14:23 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:14:23 user nova-compute[72724]:   <serial>143a533d-fb45-4c5b-a39c-d1d518e141cf</serial>
Aug 17 17:14:23 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:14:23 user nova-compute[72724]: </disk>
Aug 17 17:14:23 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292463.5218942, e4d3bac6-de98-4f05-81b0-9e5882d95711 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:14:23 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config.
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'auRCKtpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:14:23 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab919a32-8327-4308-a901-003e5810b1eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[47989fc0-aeb6-44be-af77-c6571bd0f560]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:14:23 user nova-compute[72724]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf (non-flash)
Aug 17 17:14:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:14:23 user nova-compute[72724]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf (non-flash)
Aug 17 17:14:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8411b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cde693-7737-458a-be58-5bde2ed81212]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a22891-028c-47f0-b7eb-9a1243f2188f]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be476b2-c38c-4e4e-a7e3-a8763406915b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0fc9f3-19c1-4e27-bc48-5fc56976d8dc]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[04761c2f-7e6b-460e-82b3-159742ed5575]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52da6f0-a438-4878-ad2a-7a4b95363cc9]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260]
Aug 17 17:14:23 user nova-compute[72724]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf, portal: 172.16.0.220,3260] successful.
Aug 17 17:14:23 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:143a533d-fb45-4c5b-a39c-d1d518e141cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c130688-a5ec-4de5-86dc-985a192aad88]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== disconnect_volume: return (271ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:14:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:14:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:14:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c8b1f5eb-8ef3-433e-90a7-7a5d396ee7e4 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.651s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:14:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:14:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:14:58 user nova-compute[72724]: INFO nova.compute.manager [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Terminating instance
Aug 17 17:14:58 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-8d340e83-b69e-4a4e-9f6b-e497f549370d req-3b5e0f80-cc8b-4516-be6e-26ece327b212 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-vif-unplugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8d340e83-b69e-4a4e-9f6b-e497f549370d req-3b5e0f80-cc8b-4516-be6e-26ece327b212 service nova] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8d340e83-b69e-4a4e-9f6b-e497f549370d req-3b5e0f80-cc8b-4516-be6e-26ece327b212 service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-8d340e83-b69e-4a4e-9f6b-e497f549370d req-3b5e0f80-cc8b-4516-be6e-26ece327b212 service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-8d340e83-b69e-4a4e-9f6b-e497f549370d req-3b5e0f80-cc8b-4516-be6e-26ece327b212 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] No waiting events found dispatching network-vif-unplugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-8d340e83-b69e-4a4e-9f6b-e497f549370d req-3b5e0f80-cc8b-4516-be6e-26ece327b212 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-vif-unplugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Instance destroyed successfully.
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'resources' on Instance uuid 7ebd6306-e847-4926-b19d-08bf7fdc9170 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:13:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1423545135',display_name='tempest-TestVolumeBootPattern-server-1423545135',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1423545135',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:13:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-bhg46m0v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:13:30Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=7ebd6306-e847-4926-b19d-08bf7fdc9170,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "address": "fa:16:3e:b8:20:92", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5bedfb3-fd", "ovs_interfaceid": "e5bedfb3-fd37-49cf-8248-4678fc59ecce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_vif [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5bedfb3-fd, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:14:59 user nova-compute[72724]: INFO os_vif [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:20:92,bridge_name='br-int',has_traffic_filtering=True,id=e5bedfb3-fd37-49cf-8248-4678fc59ecce,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5bedfb3-fd')
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvlMIgpk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:14:59 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66757e5b-1204-4b3d-9fd2-fb62b1b896bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ece123-4a44-48dc-9211-8fe33594ce1b]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:14:59 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 (non-flash)
Aug 17 17:14:59 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c8599f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7191e8b-0d27-404c-b9f9-0297704a3998]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13b095a-dabd-42ee-8832-a1a97c0cdf2c]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c75d1f-7f2f-4320-8782-7c5ede10196f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f141f6b7-7970-41c0-8e0a-b8c754008c6d]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_629fe71', '/dev/disk/by-id/scsi-26535303535366236', '/dev/disk/by-id/scsi-1SCST_BIO629fe71-e50556b61b7f5317') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e64da40-83ac-4123-aa17-4c99f7625e30]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36027f4-f7d9-4ac0-adc0-8d3fe7964eed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --logout" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79e99e4-3be6-4ec1-9ab6-24c9f13e77a5]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260]
Aug 17 17:14:59 user nova-compute[72724]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076, portal: 172.16.0.220,3260] successful.
Aug 17 17:14:59 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3fb16703-0bd0-433c-bd2d-4f02a28d2076 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6d8bb5-1c26-4b6d-9cc3-f96c2e72d874]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.252s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== disconnect_volume: return (253ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:14:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:14:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Deleting instance files /opt/stack/data/nova/instances/7ebd6306-e847-4926-b19d-08bf7fdc9170_del
Aug 17 17:14:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Deletion of /opt/stack/data/nova/instances/7ebd6306-e847-4926-b19d-08bf7fdc9170_del complete
Aug 17 17:15:00 user nova-compute[72724]: INFO nova.compute.manager [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 17 17:15:00 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:15:00 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:15:00 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:15:00 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:15:00 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Took 0.46 seconds to deallocate network for instance.
Aug 17 17:15:00 user nova-compute[72724]: DEBUG nova.compute.manager [req-e0dd8735-ff1b-4d45-aae7-4181cde8a5e6 req-b8d50990-3418-4831-8a93-03155bb3b9f4 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-vif-deleted-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:15:01 user nova-compute[72724]: INFO nova.compute.manager [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Took 0.73 seconds to detach 1 volumes for instance.
Aug 17 17:15:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-55e45ae7-6b17-4738-a443-c89975939fcf req-f4eeab05-d843-4c7b-884e-7edc4e27b5d7 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received event network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-55e45ae7-6b17-4738-a443-c89975939fcf req-f4eeab05-d843-4c7b-884e-7edc4e27b5d7 service nova] Acquiring lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-55e45ae7-6b17-4738-a443-c89975939fcf req-f4eeab05-d843-4c7b-884e-7edc4e27b5d7 service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-55e45ae7-6b17-4738-a443-c89975939fcf req-f4eeab05-d843-4c7b-884e-7edc4e27b5d7 service nova] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG nova.compute.manager [req-55e45ae7-6b17-4738-a443-c89975939fcf req-f4eeab05-d843-4c7b-884e-7edc4e27b5d7 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] No waiting events found dispatching network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:15:01 user nova-compute[72724]: WARNING nova.compute.manager [req-55e45ae7-6b17-4738-a443-c89975939fcf req-f4eeab05-d843-4c7b-884e-7edc4e27b5d7 service nova] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Received unexpected event network-vif-plugged-e5bedfb3-fd37-49cf-8248-4678fc59ecce for instance with vm_state active and task_state deleting.
Aug 17 17:15:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Deleting volume: 3fb16703-0bd0-433c-bd2d-4f02a28d2076 {{(pid=72724) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:01 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Deleted allocations for instance 7ebd6306-e847-4926-b19d-08bf7fdc9170
Aug 17 17:15:01 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e70a03a8-4af5-4c1c-aa8b-7b283600fda3 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "7ebd6306-e847-4926-b19d-08bf7fdc9170" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.686s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:15:12 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292499.6472948, 7ebd6306-e847-4926-b19d-08bf7fdc9170 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:15:14 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] VM Stopped (Lifecycle Event)
Aug 17 17:15:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-ea92286b-c4ab-4361-9532-b3bb38e46e2f None None] [instance: 7ebd6306-e847-4926-b19d-08bf7fdc9170] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:15:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG nova.objects.instance [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:18 user nova-compute[72724]: INFO nova.compute.manager [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attaching volume 010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 to /dev/vdb
Aug 17 17:15:18 user nova-compute[72724]: DEBUG os_brick.utils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c6f1a9-bc83-4187-9004-47128bbc2ae9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a796ca79-c610-4c59-a989-2e07adb661b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5126c099-06ee-46de-ba0d-f14b5a4e174b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9a8a93-d69f-4a0a-8603-f338c6f36c20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:15:18 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[20782bb7-e229-40c4-8afe-7d03d7641960]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG os_brick.utils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating existing volume attachment record: 5cee5256-089d-48d5-adfc-261d364d4f9e {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:15:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:15:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:15:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:15:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=25.346343994140625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:15:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.345s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kylfwBDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:15:28 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:15:28 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:15:28 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[013b58db-4527-4262-a20d-22b14e13e05a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:15:28 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2900cd05-fb65-4ccb-a51d-5aa2e48e7a09]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8] added
Aug 17 17:15:28 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49b8b4d-b25a-4999-ae58-d797f7a39b7f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca7f93-afbf-40d0-9958-37804f2ba905]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kylfwBDX {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kylfwBDX" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[691353a5-93e1-424c-93fe-f2111e021655]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kylfwBDX'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df2cc62-853b-40ba-8eae-b77f1ae556de]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e666174-34d3-44f8-91fc-1d56e55ca85b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:15:28 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:15:28 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:15:28 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:15:28 user nova-compute[72724]: 
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e0a2b9-f32d-4c9f-9c84-f9cf0ea69133]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260]
Aug 17 17:15:28 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260] successful.
Aug 17 17:15:28 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a814d7db-f7e6-4663-88c1-d13498f33cf8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fff8d84-df13-4f68-b431-01d4664c8c06]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 (non-flash)
Aug 17 17:15:28 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 (non-flash)
Aug 17 17:15:28 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7767e234-9f35-4970-9e06-1eb581af0c4d]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:15:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kylfwBDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23830393062656366', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830393062656366', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:15:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:15:29 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:15:29 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:15:29 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:15:29 user nova-compute[72724]:   <serial>010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8</serial>
Aug 17 17:15:29 user nova-compute[72724]: </disk>
Aug 17 17:15:29 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:15:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:15:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:15:30 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No VIF found with MAC fa:16:3e:23:f9:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:15:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-855ee722-bf49-4d03-a842-a49e0e18e97f tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.983s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:15:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:15:32 user nova-compute[72724]: INFO nova.compute.manager [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Detaching volume 010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8
Aug 17 17:15:32 user nova-compute[72724]: INFO nova.virt.block_device [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attempting to driver detach volume 010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 from mountpoint /dev/vdb
Aug 17 17:15:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Attempting to detach device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:15:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:15:32 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:15:32 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:15:32 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:15:32 user nova-compute[72724]:   <serial>010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8</serial>
Aug 17 17:15:32 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:15:32 user nova-compute[72724]: </disk>
Aug 17 17:15:32 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:15:32 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config.
Aug 17 17:15:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:15:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:15:32 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:15:32 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:15:32 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:15:32 user nova-compute[72724]:   <serial>010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8</serial>
Aug 17 17:15:32 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:15:32 user nova-compute[72724]: </disk>
Aug 17 17:15:32 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292533.3001344, e4d3bac6-de98-4f05-81b0-9e5882d95711 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:15:33 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config.
Aug 17 17:15:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kylfwBDX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:15:33 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb345dc-d32d-42b8-b3fa-af3c5837cf0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8144fbee-dbe3-48fb-80ae-1e39237efcff]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 (non-flash)
Aug 17 17:15:33 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 (non-flash)
Aug 17 17:15:33 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e027edd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0a6104-0018-4286-8a15-008f7928c326]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42fec31-a900-4956-9369-67840c53bc26]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad233a0-37da-4af5-888e-39bb8eaeb831]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7aa7fb-334b-4eaf-9918-d76a87d723ff]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[75227052-eacd-4f8b-95ff-c595bccc9e43]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7bbc3d-37ad-433c-aae2-50c33cab00f9]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260]
Aug 17 17:15:33 user nova-compute[72724]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8, portal: 172.16.0.220,3260] successful.
Aug 17 17:15:33 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010da3a1-f7f0-49fa-a2ae-cdb2b850f8d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c53681-c827-458f-b762-607c4e1aa3b3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.272s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== disconnect_volume: return (273ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:15:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:15:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:15:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-6ff221f6-b1e6-4e93-a48b-512122213fbe tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.601s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:15:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:15:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:15:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:16:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:16:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:13 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:16:14 user nova-compute[72724]: INFO nova.compute.claims [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Claim successful on node user
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.network.neutron [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:16:14 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:14 user nova-compute[72724]: INFO nova.virt.block_device [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Booting with volume 1672d882-81a8-40f3-8b67-15933d134e16 at /dev/vda
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.policy [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e503ef7b08034c8ea4135912c91d9c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c38413cbee44af48869f91b661b1333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG os_brick.utils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b833ae-aafd-49b8-bfa7-c40a68fb1da0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[379e39f8-54d9-4924-b895-05e7b3e12b86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2024af87-2f0c-4b63-8ed2-d945f8d1eac7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc9741-9d2b-4c89-9e3c-b6c7f3b6e348]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:16:14 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:16:14 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b42aef0-e2e5-462d-84b8-ad0e3ab7fa36]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG os_brick.utils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:16:14 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating existing volume attachment record: 6796747d-c4c4-4cfc-baeb-ebbc35ba9ee3 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:16:15 user nova-compute[72724]: DEBUG nova.network.neutron [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Successfully created port: 8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:16:15 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Successfully updated port: 8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquired lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-changed-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Refreshing instance network info cache due to event network-changed-8ee22e41-8639-4c71-9199-fef4d477ad3a. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] Acquiring lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.network.neutron [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating instance_info_cache with network_info: [{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Releasing lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Instance network_info: |[{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] Acquired lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:16:16 user nova-compute[72724]: DEBUG nova.network.neutron [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Refreshing network info cache for port 8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:16:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updated VIF entry in instance network info cache for port 8ee22e41-8639-4c71-9199-fef4d477ad3a. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:16:17 user nova-compute[72724]: DEBUG nova.network.neutron [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating instance_info_cache with network_info: [{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:16:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9d57adad-13df-42fc-a0a4-a24dac402e5c req-283ba438-fb7c-400f-83ba-44e38f8ea0ed service nova] Releasing lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:16:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:16:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Skipping network cache update for instance because it is Building. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:16:20 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:22 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:16:22 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8769MB free_disk=25.336746215820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 443cd1dc-bf85-4132-be2d-98258f6a3880 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:16:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:16:25 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Creating image(s)
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Ensure instance console log exists: /opt/stack/data/nova/instances/443cd1dc-bf85-4132-be2d-98258f6a3880/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Start _get_guest_xml network_info=[{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6796747d-c4c4-4cfc-baeb-ebbc35ba9ee3', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXhmUjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '443cd1dc-bf85-4132-be2d-98258f6a3880', 'attached_at': '', 'detached_at': '', 'volume_id': '1672d882-81a8-40f3-8b67-15933d134e16', 'serial': '1672d882-81a8-40f3-8b67-15933d134e16'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:16:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:16:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXhmUjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:16:25 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:16:25 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:16:25 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d9749b-8ac6-48f8-9f11-58cffcc590f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:16:25 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[16703e21-1308-42cc-89ae-c84455d318ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16] added
Aug 17 17:16:25 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[287707d7-bd20-4c4a-8bba-792051744b39]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c53d69-2ea9-4119-9093-bb66d59ba12c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgXhmUjB {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DgXhmUjB" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[569b8380-36de-4f37-a6ee-d334f39b4ca0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DgXhmUjB'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[79de97f5-3ad0-46e1-a5fc-b224b944c410]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b33b3c-80f5-4129-927d-1c1d9061bf11]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:16:25 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:16:25 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:16:25 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:16:25 user nova-compute[72724]: 
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed0505-9480-4bb5-8a72-98c500f529df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260]
Aug 17 17:16:25 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260] successful.
Aug 17 17:16:25 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[550e8e95-5b2c-4804-8c43-b7812e5847c8]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45e0221-0647-46ef-9786-342a913ca174]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:25 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:25 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab270157-cbdb-4d52-870b-03c578163651]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:16:25 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXhmUjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23632623335346430', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632623335346430', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1595905060',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1595905060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1595905060',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyfUH3XFcffAO/Gltdv+J4YSl/1++Il7LTp2wj7S/Csb0q/glaCUk3zKv67TuEhik4XNXU28HrF3EI8oRJy2BlhkcdvM6OfW7pu/ZWFyyW44n90Khms7Pz4fkh7szYpug==',key_name='tempest-keypair-641781323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-xkgpdw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=443cd1dc-bf85-4132-be2d-98258f6a3880,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.objects.instance [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'pci_devices' on Instance uuid 443cd1dc-bf85-4132-be2d-98258f6a3880 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:16:26 user nova-compute[72724]:   <uuid>443cd1dc-bf85-4132-be2d-98258f6a3880</uuid>
Aug 17 17:16:26 user nova-compute[72724]:   <name>instance-00000030</name>
Aug 17 17:16:26 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:16:26 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:16:26 user nova-compute[72724]:   <metadata>
Aug 17 17:16:26 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:16:26 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:16:26 user nova-compute[72724]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1595905060</nova:name>
Aug 17 17:16:26 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:16:25</nova:creationTime>
Aug 17 17:16:26 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:16:26 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:16:26 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:16:26 user nova-compute[72724]:       <nova:owner>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:user uuid="e503ef7b08034c8ea4135912c91d9c0f">tempest-TestVolumeBootPattern-924115856-project-member</nova:user>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:project uuid="0c38413cbee44af48869f91b661b1333">tempest-TestVolumeBootPattern-924115856</nova:project>
Aug 17 17:16:26 user nova-compute[72724]:       </nova:owner>
Aug 17 17:16:26 user nova-compute[72724]:       <nova:ports>
Aug 17 17:16:26 user nova-compute[72724]:         <nova:port uuid="8ee22e41-8639-4c71-9199-fef4d477ad3a">
Aug 17 17:16:26 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 17 17:16:26 user nova-compute[72724]:         </nova:port>
Aug 17 17:16:26 user nova-compute[72724]:       </nova:ports>
Aug 17 17:16:26 user nova-compute[72724]:     </nova:instance>
Aug 17 17:16:26 user nova-compute[72724]:   </metadata>
Aug 17 17:16:26 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:16:26 user nova-compute[72724]:     <system>
Aug 17 17:16:26 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:16:26 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:16:26 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:16:26 user nova-compute[72724]:       <entry name="serial">443cd1dc-bf85-4132-be2d-98258f6a3880</entry>
Aug 17 17:16:26 user nova-compute[72724]:       <entry name="uuid">443cd1dc-bf85-4132-be2d-98258f6a3880</entry>
Aug 17 17:16:26 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:16:26 user nova-compute[72724]:     </system>
Aug 17 17:16:26 user nova-compute[72724]:   </sysinfo>
Aug 17 17:16:26 user nova-compute[72724]:   <os>
Aug 17 17:16:26 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:16:26 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:16:26 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:16:26 user nova-compute[72724]:   </os>
Aug 17 17:16:26 user nova-compute[72724]:   <features>
Aug 17 17:16:26 user nova-compute[72724]:     <acpi/>
Aug 17 17:16:26 user nova-compute[72724]:     <apic/>
Aug 17 17:16:26 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:16:26 user nova-compute[72724]:   </features>
Aug 17 17:16:26 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:16:26 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:16:26 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:16:26 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:16:26 user nova-compute[72724]:   </clock>
Aug 17 17:16:26 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:16:26 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:16:26 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:16:26 user nova-compute[72724]:   </cpu>
Aug 17 17:16:26 user nova-compute[72724]:   <devices>
Aug 17 17:16:26 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 17:16:26 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:16:26 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 17:16:26 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:16:26 user nova-compute[72724]:       <serial>1672d882-81a8-40f3-8b67-15933d134e16</serial>
Aug 17 17:16:26 user nova-compute[72724]:     </disk>
Aug 17 17:16:26 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:16:26 user nova-compute[72724]:       <mac address="fa:16:3e:0f:ac:85"/>
Aug 17 17:16:26 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:16:26 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:16:26 user nova-compute[72724]:       <target dev="tap8ee22e41-86"/>
Aug 17 17:16:26 user nova-compute[72724]:     </interface>
Aug 17 17:16:26 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:16:26 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/443cd1dc-bf85-4132-be2d-98258f6a3880/console.log" append="off"/>
Aug 17 17:16:26 user nova-compute[72724]:     </serial>
Aug 17 17:16:26 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:16:26 user nova-compute[72724]:     <video>
Aug 17 17:16:26 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:16:26 user nova-compute[72724]:     </video>
Aug 17 17:16:26 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:16:26 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:16:26 user nova-compute[72724]:     </rng>
Aug 17 17:16:26 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:16:26 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:16:26 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:16:26 user nova-compute[72724]:     </memballoon>
Aug 17 17:16:26 user nova-compute[72724]:   </devices>
Aug 17 17:16:26 user nova-compute[72724]: </domain>
Aug 17 17:16:26 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1595905060',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1595905060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1595905060',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyfUH3XFcffAO/Gltdv+J4YSl/1++Il7LTp2wj7S/Csb0q/glaCUk3zKv67TuEhik4XNXU28HrF3EI8oRJy2BlhkcdvM6OfW7pu/ZWFyyW44n90Khms7Pz4fkh7szYpug==',key_name='tempest-keypair-641781323',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-xkgpdw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:16:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=443cd1dc-bf85-4132-be2d-98258f6a3880,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG os_vif [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8ee22e41-86, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8ee22e41-86, col_values=(('external_ids', {'iface-id': '8ee22e41-8639-4c71-9199-fef4d477ad3a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:ac:85', 'vm-uuid': '443cd1dc-bf85-4132-be2d-98258f6a3880'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:26 user nova-compute[72724]: INFO os_vif [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86')
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No VIF found with MAC fa:16:3e:0f:ac:85, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG nova.objects.instance [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:26 user nova-compute[72724]: INFO nova.compute.manager [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attaching volume ce4c876e-815e-4278-9d16-0375cc74d89e to /dev/vdb
Aug 17 17:16:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67bc941-3d28-4003-843e-56b6172ef5b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae08f10-5fe2-4c28-b5e5-258ad397d275]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1090c3e3-b2af-4c63-b617-98ddb461109f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[092dd010-3c43-48f2-8cb2-6302313bf48e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:16:27 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:16:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6663cbe9-d5bd-4326-89e8-2a99b20e65bb]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG os_brick.utils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating existing volume attachment record: 5f50afb8-0049-422f-b804-5fab1ec5a6ce {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-42c9bc63-e012-4238-b22a-35f355fcbc1d req-fa7bf8b3-3f70-4634-8e2c-23d8708e9c4c service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-42c9bc63-e012-4238-b22a-35f355fcbc1d req-fa7bf8b3-3f70-4634-8e2c-23d8708e9c4c service nova] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-42c9bc63-e012-4238-b22a-35f355fcbc1d req-fa7bf8b3-3f70-4634-8e2c-23d8708e9c4c service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-42c9bc63-e012-4238-b22a-35f355fcbc1d req-fa7bf8b3-3f70-4634-8e2c-23d8708e9c4c service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-42c9bc63-e012-4238-b22a-35f355fcbc1d req-fa7bf8b3-3f70-4634-8e2c-23d8708e9c4c service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] No waiting events found dispatching network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:16:28 user nova-compute[72724]: WARNING nova.compute.manager [req-42c9bc63-e012-4238-b22a-35f355fcbc1d req-fa7bf8b3-3f70-4634-8e2c-23d8708e9c4c service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received unexpected event network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a for instance with vm_state building and task_state spawning.
Aug 17 17:16:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292589.8937078, 443cd1dc-bf85-4132-be2d-98258f6a3880 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:16:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] VM Resumed (Lifecycle Event)
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:16:29 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Instance spawned successfully.
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:16:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292589.89971, 443cd1dc-bf85-4132-be2d-98258f6a3880 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:16:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] VM Started (Lifecycle Event)
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:16:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:16:29 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:16:30 user nova-compute[72724]: INFO nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Took 4.83 seconds to spawn the instance on the hypervisor.
Aug 17 17:16:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:16:30 user nova-compute[72724]: INFO nova.compute.manager [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Took 15.72 seconds to build instance.
Aug 17 17:16:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-d5b9055e-ed95-43f6-bafb-a597c0bb0da6 req-448d9d45-bf00-48df-978a-dced6f5b1a77 service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:16:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5b9055e-ed95-43f6-bafb-a597c0bb0da6 req-448d9d45-bf00-48df-978a-dced6f5b1a77 service nova] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5b9055e-ed95-43f6-bafb-a597c0bb0da6 req-448d9d45-bf00-48df-978a-dced6f5b1a77 service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d5b9055e-ed95-43f6-bafb-a597c0bb0da6 req-448d9d45-bf00-48df-978a-dced6f5b1a77 service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:30 user nova-compute[72724]: DEBUG nova.compute.manager [req-d5b9055e-ed95-43f6-bafb-a597c0bb0da6 req-448d9d45-bf00-48df-978a-dced6f5b1a77 service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] No waiting events found dispatching network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:16:30 user nova-compute[72724]: WARNING nova.compute.manager [req-d5b9055e-ed95-43f6-bafb-a597c0bb0da6 req-448d9d45-bf00-48df-978a-dced6f5b1a77 service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received unexpected event network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a for instance with vm_state building and task_state spawning.
Aug 17 17:16:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-363307eb-49ca-4c8a-950b-ebdb5d5c5665 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.806s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbGncykw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:16:37 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:16:37 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:16:37 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcff4b11-66a7-48e6-8213-327c72e99868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:16:37 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[710e33e7-6459-467f-b396-cae4ecb5cc74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e] added
Aug 17 17:16:37 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0ff5ce-9f2a-425f-8a7a-d0207bbed329]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18fffe4-ecb9-40c4-ad1c-998f7086ad45]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbGncykw {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HbGncykw" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f6e585-b149-4659-aac0-b5dba6595c69]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HbGncykw'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[07838c01-c289-47d2-8a20-9160d73eac76]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ac415c8-02ba-4afa-ac7e-7b2c043e6259]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:37 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:37 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:16:37 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[66797db9-a867-4be6-8376-bf46421ed3bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260]
Aug 17 17:16:38 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260] successful.
Aug 17 17:16:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6635ac-5006-4b3e-b957-5d379e1aea6a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f3ce72-d0e7-44bf-8b49-a0675449e355]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:38 user nova-compute[72724]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e (non-flash)
Aug 17 17:16:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:38 user nova-compute[72724]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e (non-flash)
Aug 17 17:16:38 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e465c45a-d36c-4ac3-8f2b-0a0b1d6c32eb]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:16:38 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbGncykw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23237636436363764', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237636436363764', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:16:39 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:16:39 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:16:39 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:16:39 user nova-compute[72724]:   <serial>ce4c876e-815e-4278-9d16-0375cc74d89e</serial>
Aug 17 17:16:39 user nova-compute[72724]: </disk>
Aug 17 17:16:39 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No VIF found with MAC fa:16:3e:23:f9:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:16:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-97f503d4-3871-4019-a799-c3d931f1bf3c tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.717s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:16:41 user nova-compute[72724]: INFO nova.compute.manager [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Detaching volume ce4c876e-815e-4278-9d16-0375cc74d89e
Aug 17 17:16:41 user nova-compute[72724]: INFO nova.virt.block_device [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attempting to driver detach volume ce4c876e-815e-4278-9d16-0375cc74d89e from mountpoint /dev/vdb
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Attempting to detach device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:16:41 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:16:41 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:16:41 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:16:41 user nova-compute[72724]:   <serial>ce4c876e-815e-4278-9d16-0375cc74d89e</serial>
Aug 17 17:16:41 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:16:41 user nova-compute[72724]: </disk>
Aug 17 17:16:41 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:16:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config.
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:16:41 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:16:41 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:16:41 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:16:41 user nova-compute[72724]:   <serial>ce4c876e-815e-4278-9d16-0375cc74d89e</serial>
Aug 17 17:16:41 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:16:41 user nova-compute[72724]: </disk>
Aug 17 17:16:41 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292601.900836, e4d3bac6-de98-4f05-81b0-9e5882d95711 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:16:41 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config.
Aug 17 17:16:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HbGncykw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:16:41 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c166ca-f914-4fac-9e43-95643b9db9ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f26d92d-9690-4f93-813e-f5989e97e70b]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:41 user nova-compute[72724]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e (non-flash)
Aug 17 17:16:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:16:41 user nova-compute[72724]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e (non-flash)
Aug 17 17:16:41 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c834c040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd95df72-56b6-4938-b0a2-43c830fdc368]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:41 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2689418c-e88a-47c2-a760-c1c448e9728d]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad1c9cf-2415-45d6-a372-0435c2b48831]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68992e6-a963-4f9d-96ad-23b6710a78a5]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f73da6-b798-4999-851f-9396d9db442f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da2b884-5803-4e14-b741-cc65314526f4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260]
Aug 17 17:16:42 user nova-compute[72724]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e, portal: 172.16.0.220,3260] successful.
Aug 17 17:16:42 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce4c876e-815e-4278-9d16-0375cc74d89e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da9c20-3a20-4eae-b978-274ed75f9c1d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== disconnect_volume: return (267ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG nova.objects.instance [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:16:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79e36771-2a49-4a28-bf0a-c7fc1927d4b0 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.592s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:16:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:16:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:14 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:17:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:17 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:17:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:17:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:17:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:17:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:17:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:17:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8660MB free_disk=25.334938049316406GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 443cd1dc-bf85-4132-be2d-98258f6a3880 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:17:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:17:22 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:17:23 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:17:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:17:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:17:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:17:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:17:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:17:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:17:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:17:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:17:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG nova.objects.instance [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:17:35 user nova-compute[72724]: INFO nova.compute.manager [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attaching volume 68494180-258d-41a4-aefc-be3c7ef502da to /dev/vdb
Aug 17 17:17:35 user nova-compute[72724]: DEBUG os_brick.utils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[999635f6-212e-4edb-bb21-c17cd380bdad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02c5a42-fe41-4d0f-a201-0bc9d5e2a904]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45dd9a8-fa72-4a99-9413-c12a5ba732c4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ec0c33-4832-4ed6-8840-cfb4726a1357]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:17:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:17:36 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:17:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfbd5f1-d419-489b-869c-9a2e01fe72f5]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG os_brick.utils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating existing volume attachment record: 7df8745d-20af-4604-83cb-60ca4c60970b {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:17:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:17:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxDXnwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:17:46 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:17:46 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:17:46 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c07a03-4cc0-4a94-b774-51898f7555bc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:17:46 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9bf7b9-dcde-41bb-bb93-a7597531f0f2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da] added
Aug 17 17:17:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[beef8754-cd6a-4833-90b5-cc55df9bef0c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eb9ec7-c75a-4388-a5e3-108b9f58c6a4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPxDXnwa {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPxDXnwa" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac6aac4-a983-4d31-afe0-7337a9eefe9d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPxDXnwa'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[390d6b33-3be8-42c0-b2f5-c102c7b03aa4]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638e328-96a5-4b3b-ab7d-ff684c299c03]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:17:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:17:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[53246ff8-32fa-470e-ae02-88066a02a3af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260]
Aug 17 17:17:46 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260] successful.
Aug 17 17:17:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c010a03-ae06-4b98-a380-e1b765d35ee3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5afcceed-eeb7-4b3c-bbb4-8a3d04a1e332]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:17:46 user nova-compute[72724]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da (non-flash)
Aug 17 17:17:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:17:46 user nova-compute[72724]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da (non-flash)
Aug 17 17:17:46 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] HCTL ('34', '-', '-', 0) found on session 59 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4c5990-c9d4-4529-9f54-d9e1c47568da]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:17:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Searching for a device in session 59 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxDXnwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23263663032646361', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263663032646361', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG nova.objects.instance [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:17:47 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:17:47 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:17:47 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:17:47 user nova-compute[72724]:   <serial>68494180-258d-41a4-aefc-be3c7ef502da</serial>
Aug 17 17:17:47 user nova-compute[72724]: </disk>
Aug 17 17:17:47 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:17:47 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] No VIF found with MAC fa:16:3e:23:f9:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:17:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dd1877ba-e056-4d85-b39b-62388337d359 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.209s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:17:50 user nova-compute[72724]: INFO nova.compute.manager [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Detaching volume 68494180-258d-41a4-aefc-be3c7ef502da
Aug 17 17:17:50 user nova-compute[72724]: INFO nova.virt.block_device [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Attempting to driver detach volume 68494180-258d-41a4-aefc-be3c7ef502da from mountpoint /dev/vdb
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Attempting to detach device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:17:50 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:17:50 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:17:50 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:17:50 user nova-compute[72724]:   <serial>68494180-258d-41a4-aefc-be3c7ef502da</serial>
Aug 17 17:17:50 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:17:50 user nova-compute[72724]: </disk>
Aug 17 17:17:50 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:17:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the persistent domain config.
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:17:50 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:17:50 user nova-compute[72724]:   <source dev="/dev/sdc"/>
Aug 17 17:17:50 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:17:50 user nova-compute[72724]:   <serial>68494180-258d-41a4-aefc-be3c7ef502da</serial>
Aug 17 17:17:50 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:17:50 user nova-compute[72724]: </disk>
Aug 17 17:17:50 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692292670.7400055, e4d3bac6-de98-4f05-81b0-9e5882d95711 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:17:50 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully detached device vdb from instance e4d3bac6-de98-4f05-81b0-9e5882d95711 from the live domain config.
Aug 17 17:17:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPxDXnwa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:17:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b652a86d-54b5-44ab-b934-680fbce54159]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcd4ad8-1b88-4e30-8603-0357f1f47fc8]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:17:50 user nova-compute[72724]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da (non-flash)
Aug 17 17:17:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:17:50 user nova-compute[72724]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da (non-flash)
Aug 17 17:17:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81bc160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fc0120-fbbc-458e-b2ed-69fded5c6186]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94f5dea-d60e-4ad8-8e9c-1bdf09487ed8]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ea0e5a-e4d9-4d02-a174-687bd739418b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ed914d-ce54-4c01-a0f3-e837a2fc2eb7]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[026d7f3a-6086-4a39-8c44-f07f59671448]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6308898-76a5-4af9-899a-1ded128f5a83]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260]
Aug 17 17:17:50 user nova-compute[72724]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da, portal: 172.16.0.220,3260] successful.
Aug 17 17:17:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68494180-258d-41a4-aefc-be3c7ef502da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2ef5f7-9506-4c82-a24c-e81ca9b17a64]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] <== disconnect_volume: return (264ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'flavor' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:17:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-c3286b31-72e1-41fb-9e66-bf5055e665df tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:17:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:17:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-changed-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:18:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Refreshing instance network info cache due to event network-changed-8ee22e41-8639-4c71-9199-fef4d477ad3a. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:18:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] Acquiring lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:18:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] Acquired lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:18:05 user nova-compute[72724]: DEBUG nova.network.neutron [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Refreshing network info cache for port 8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updated VIF entry in instance network info cache for port 8ee22e41-8639-4c71-9199-fef4d477ad3a. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG nova.network.neutron [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating instance_info_cache with network_info: [{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-080938a5-6199-4de4-86be-da761e1b9527 req-63f22d3c-7b75-4fb0-9038-df99256e6f5d service nova] Releasing lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:18:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:15 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:18:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:18:18 user nova-compute[72724]: INFO nova.compute.claims [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Claim successful on node user
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.243s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:18:18 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:18:18 user nova-compute[72724]: INFO nova.virt.block_device [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Booting with volume snapshot 452b9b06-1191-4b35-9a0e-d0e9b09f40a4 at /dev/vda
Aug 17 17:18:18 user nova-compute[72724]: DEBUG nova.policy [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e503ef7b08034c8ea4135912c91d9c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c38413cbee44af48869f91b661b1333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:19 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Successfully created port: e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:18:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Successfully updated port: e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquired lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-changed-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG nova.compute.manager [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Refreshing instance network info cache due to event network-changed-e585888a-1274-49d5-956d-46968617cc76. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] Acquiring lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.network.neutron [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updating instance_info_cache with network_info: [{"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Releasing lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Instance network_info: |[{"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] Acquired lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Refreshing network info cache for port e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:18:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:18:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8666MB free_disk=25.333202362060547GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 443cd1dc-bf85-4132-be2d-98258f6a3880 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 37a71c73-bb05-453e-884f-f231cb3a77f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updated VIF entry in instance network info cache for port e585888a-1274-49d5-956d-46968617cc76. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG nova.network.neutron [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updating instance_info_cache with network_info: [{"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:18:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9dccd769-6796-4b09-81b0-accd90ecd6b0 req-e0fc1a6d-2454-4d27-a5b2-47da16075c74 service nova] Releasing lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:18:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:18:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:18:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:18:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:18:23 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating instance_info_cache with network_info: [{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:18:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:18:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG os_brick.utils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf17739-4bbc-4960-a56e-e8108c72c85b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab82cb9-2119-4ac1-a1b2-18c9dbaf8bf3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[facdc14e-2089-4420-b186-6160106c9184]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[172404f1-d600-4059-97d8-d532abfee57f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:18:24 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:18:24 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f3db3-bb63-4fd2-8e74-d76d9f92dbf1]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG os_brick.utils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:18:24 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updating existing volume attachment record: 5704bb9d-c787-40b1-a8b6-8fb820d14796 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:18:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:18:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:18:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:18:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:18:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:18:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:18:34 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Creating image(s)
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Ensure instance console log exists: /opt/stack/data/nova/instances/37a71c73-bb05-453e-884f-f231cb3a77f9/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Start _get_guest_xml network_info=[{"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T17:18:07Z,direct_url=<?>,disk_format='qcow2',id=5ee08b8e-99dc-4533-9397-1a77e8b92021,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1985177079',owner='0c38413cbee44af48869f91b661b1333',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T17:18:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '5704bb9d-c787-40b1-a8b6-8fb820d14796', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEUYXJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37a71c73-bb05-453e-884f-f231cb3a77f9', 'attached_at': '', 'detached_at': '', 'volume_id': 'b30034a5-7309-411a-8136-fa87065a25a0', 'serial': 'b30034a5-7309-411a-8136-fa87065a25a0'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': True, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:18:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:18:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-17T17:18:07Z,direct_url=<?>,disk_format='qcow2',id=5ee08b8e-99dc-4533-9397-1a77e8b92021,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1985177079',owner='0c38413cbee44af48869f91b661b1333',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-17T17:18:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEUYXJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:18:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:18:34 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:18:34 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[435527d6-ee7b-40b2-8b04-91e945c831e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:18:34 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c511310a-5f6f-44a9-b526-68c609a8749a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0] added
Aug 17 17:18:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6f617a-2ab0-422a-a9b2-178fc77d30ed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf695da-85dd-4dcf-af4a-e64eaf11057f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpEUYXJA {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HpEUYXJA" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe078703-db45-4cc3-8ee7-73361a69e5ac]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HpEUYXJA'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[da739c24-4527-4c25-8bd5-a24b59970081]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8048be18-aec6-48a0-8bac-3aa75554bc40]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:18:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:18:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[826c28c9-5094-4b68-a056-445453ceb370]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260]
Aug 17 17:18:34 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260] successful.
Aug 17 17:18:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a044e9b3-86fa-4572-b0b4-c6b318f079ed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[710b7509-0c0b-4f43-a9db-05504259dd0a]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:18:34 user nova-compute[72724]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 (non-flash)
Aug 17 17:18:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:18:34 user nova-compute[72724]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 (non-flash)
Aug 17 17:18:34 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7402bebf-90b2-4fb5-a261-5363a14a5abc]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:18:34 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:18:35 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEUYXJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23738373961613137', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738373961613137', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-94087555',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-94087555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-94087555',id=49,image_ref='5ee08b8e-99dc-4533-9397-1a77e8b92021',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwlnCx3vpsnB2c6kFj5epu+PxbpS0c0nhNod8NFwj65PNg2CA5sWgP+ZNhnMdgrtIuPdg3Wbi+y/IHBic0vwUbVlxqIXuz2L7JD0C43BsE3rrLfj7s8kmZCMNYq7RAqxw==',key_name='tempest-keypair-853186176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-d7anx4up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-924115856',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=37a71c73-bb05-453e-884f-f231cb3a77f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'pci_devices' on Instance uuid 37a71c73-bb05-453e-884f-f231cb3a77f9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:18:36 user nova-compute[72724]:   <uuid>37a71c73-bb05-453e-884f-f231cb3a77f9</uuid>
Aug 17 17:18:36 user nova-compute[72724]:   <name>instance-00000031</name>
Aug 17 17:18:36 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:18:36 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:18:36 user nova-compute[72724]:   <metadata>
Aug 17 17:18:36 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:18:36 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:18:36 user nova-compute[72724]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-94087555</nova:name>
Aug 17 17:18:36 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:18:34</nova:creationTime>
Aug 17 17:18:36 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:18:36 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:18:36 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:18:36 user nova-compute[72724]:       <nova:owner>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:user uuid="e503ef7b08034c8ea4135912c91d9c0f">tempest-TestVolumeBootPattern-924115856-project-member</nova:user>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:project uuid="0c38413cbee44af48869f91b661b1333">tempest-TestVolumeBootPattern-924115856</nova:project>
Aug 17 17:18:36 user nova-compute[72724]:       </nova:owner>
Aug 17 17:18:36 user nova-compute[72724]:       <nova:root type="image" uuid="5ee08b8e-99dc-4533-9397-1a77e8b92021"/>
Aug 17 17:18:36 user nova-compute[72724]:       <nova:ports>
Aug 17 17:18:36 user nova-compute[72724]:         <nova:port uuid="e585888a-1274-49d5-956d-46968617cc76">
Aug 17 17:18:36 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 17 17:18:36 user nova-compute[72724]:         </nova:port>
Aug 17 17:18:36 user nova-compute[72724]:       </nova:ports>
Aug 17 17:18:36 user nova-compute[72724]:     </nova:instance>
Aug 17 17:18:36 user nova-compute[72724]:   </metadata>
Aug 17 17:18:36 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:18:36 user nova-compute[72724]:     <system>
Aug 17 17:18:36 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:18:36 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:18:36 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:18:36 user nova-compute[72724]:       <entry name="serial">37a71c73-bb05-453e-884f-f231cb3a77f9</entry>
Aug 17 17:18:36 user nova-compute[72724]:       <entry name="uuid">37a71c73-bb05-453e-884f-f231cb3a77f9</entry>
Aug 17 17:18:36 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:18:36 user nova-compute[72724]:     </system>
Aug 17 17:18:36 user nova-compute[72724]:   </sysinfo>
Aug 17 17:18:36 user nova-compute[72724]:   <os>
Aug 17 17:18:36 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:18:36 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:18:36 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:18:36 user nova-compute[72724]:   </os>
Aug 17 17:18:36 user nova-compute[72724]:   <features>
Aug 17 17:18:36 user nova-compute[72724]:     <acpi/>
Aug 17 17:18:36 user nova-compute[72724]:     <apic/>
Aug 17 17:18:36 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:18:36 user nova-compute[72724]:   </features>
Aug 17 17:18:36 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:18:36 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:18:36 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:18:36 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:18:36 user nova-compute[72724]:   </clock>
Aug 17 17:18:36 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:18:36 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:18:36 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:18:36 user nova-compute[72724]:   </cpu>
Aug 17 17:18:36 user nova-compute[72724]:   <devices>
Aug 17 17:18:36 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 17:18:36 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:18:36 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 17:18:36 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:18:36 user nova-compute[72724]:       <serial>b30034a5-7309-411a-8136-fa87065a25a0</serial>
Aug 17 17:18:36 user nova-compute[72724]:     </disk>
Aug 17 17:18:36 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:18:36 user nova-compute[72724]:       <mac address="fa:16:3e:f3:0e:19"/>
Aug 17 17:18:36 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:18:36 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:18:36 user nova-compute[72724]:       <target dev="tape585888a-12"/>
Aug 17 17:18:36 user nova-compute[72724]:     </interface>
Aug 17 17:18:36 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:18:36 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/37a71c73-bb05-453e-884f-f231cb3a77f9/console.log" append="off"/>
Aug 17 17:18:36 user nova-compute[72724]:     </serial>
Aug 17 17:18:36 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:18:36 user nova-compute[72724]:     <video>
Aug 17 17:18:36 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:18:36 user nova-compute[72724]:     </video>
Aug 17 17:18:36 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:18:36 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:18:36 user nova-compute[72724]:     </rng>
Aug 17 17:18:36 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:18:36 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:18:36 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:18:36 user nova-compute[72724]:     </memballoon>
Aug 17 17:18:36 user nova-compute[72724]:   </devices>
Aug 17 17:18:36 user nova-compute[72724]: </domain>
Aug 17 17:18:36 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-94087555',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-94087555',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-94087555',id=49,image_ref='5ee08b8e-99dc-4533-9397-1a77e8b92021',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwlnCx3vpsnB2c6kFj5epu+PxbpS0c0nhNod8NFwj65PNg2CA5sWgP+ZNhnMdgrtIuPdg3Wbi+y/IHBic0vwUbVlxqIXuz2L7JD0C43BsE3rrLfj7s8kmZCMNYq7RAqxw==',key_name='tempest-keypair-853186176',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-d7anx4up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-924115856',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:18:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=37a71c73-bb05-453e-884f-f231cb3a77f9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG os_vif [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape585888a-12, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape585888a-12, col_values=(('external_ids', {'iface-id': 'e585888a-1274-49d5-956d-46968617cc76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:0e:19', 'vm-uuid': '37a71c73-bb05-453e-884f-f231cb3a77f9'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:36 user nova-compute[72724]: INFO os_vif [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12')
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:18:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No VIF found with MAC fa:16:3e:f3:0e:19, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-38e26fbf-38a4-4152-8ad9-6fc30971c64a req-af0953da-4465-4abb-8cd5-27193f94bfdd service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-38e26fbf-38a4-4152-8ad9-6fc30971c64a req-af0953da-4465-4abb-8cd5-27193f94bfdd service nova] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-38e26fbf-38a4-4152-8ad9-6fc30971c64a req-af0953da-4465-4abb-8cd5-27193f94bfdd service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-38e26fbf-38a4-4152-8ad9-6fc30971c64a req-af0953da-4465-4abb-8cd5-27193f94bfdd service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG nova.compute.manager [req-38e26fbf-38a4-4152-8ad9-6fc30971c64a req-af0953da-4465-4abb-8cd5-27193f94bfdd service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] No waiting events found dispatching network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:18:37 user nova-compute[72724]: WARNING nova.compute.manager [req-38e26fbf-38a4-4152-8ad9-6fc30971c64a req-af0953da-4465-4abb-8cd5-27193f94bfdd service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received unexpected event network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 for instance with vm_state building and task_state spawning.
Aug 17 17:18:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292719.4171705, 37a71c73-bb05-453e-884f-f231cb3a77f9 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] VM Resumed (Lifecycle Event)
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Instance spawned successfully.
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292719.418488, 37a71c73-bb05-453e-884f-f231cb3a77f9 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] VM Started (Lifecycle Event)
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Took 4.88 seconds to spawn the instance on the hypervisor.
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-1d56a486-93e1-420b-9cd1-5838cebda148 req-e265985c-af10-4d55-b3af-e0e50d5ee214 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1d56a486-93e1-420b-9cd1-5838cebda148 req-e265985c-af10-4d55-b3af-e0e50d5ee214 service nova] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1d56a486-93e1-420b-9cd1-5838cebda148 req-e265985c-af10-4d55-b3af-e0e50d5ee214 service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-1d56a486-93e1-420b-9cd1-5838cebda148 req-e265985c-af10-4d55-b3af-e0e50d5ee214 service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:39 user nova-compute[72724]: DEBUG nova.compute.manager [req-1d56a486-93e1-420b-9cd1-5838cebda148 req-e265985c-af10-4d55-b3af-e0e50d5ee214 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] No waiting events found dispatching network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:18:39 user nova-compute[72724]: WARNING nova.compute.manager [req-1d56a486-93e1-420b-9cd1-5838cebda148 req-e265985c-af10-4d55-b3af-e0e50d5ee214 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received unexpected event network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 for instance with vm_state building and task_state spawning.
Aug 17 17:18:39 user nova-compute[72724]: INFO nova.compute.manager [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Took 21.64 seconds to build instance.
Aug 17 17:18:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-d3dff07d-f703-4a64-bfea-7d0fe50f22c5 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.730s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:18:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:18:43 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:18:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:18:56 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:18:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:18:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:16 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:19:20 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:19:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:19:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8551MB free_disk=25.331329345703125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance e4d3bac6-de98-4f05-81b0-9e5882d95711 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 443cd1dc-bf85-4132-be2d-98258f6a3880 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 37a71c73-bb05-453e-884f-f231cb3a77f9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:19:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:19:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [{"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-e4d3bac6-de98-4f05-81b0-9e5882d95711" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:26 user nova-compute[72724]: INFO nova.compute.manager [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Terminating instance
Aug 17 17:19:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-ba1efcf8-077b-412c-bf27-675d1327f521 req-c2c45ddf-0100-477e-869e-c0894142bf00 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-vif-unplugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ba1efcf8-077b-412c-bf27-675d1327f521 req-c2c45ddf-0100-477e-869e-c0894142bf00 service nova] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ba1efcf8-077b-412c-bf27-675d1327f521 req-c2c45ddf-0100-477e-869e-c0894142bf00 service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ba1efcf8-077b-412c-bf27-675d1327f521 req-c2c45ddf-0100-477e-869e-c0894142bf00 service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-ba1efcf8-077b-412c-bf27-675d1327f521 req-c2c45ddf-0100-477e-869e-c0894142bf00 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] No waiting events found dispatching network-vif-unplugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.compute.manager [req-ba1efcf8-077b-412c-bf27-675d1327f521 req-c2c45ddf-0100-477e-869e-c0894142bf00 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-vif-unplugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Instance destroyed successfully.
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lazy-loading 'resources' on Instance uuid e4d3bac6-de98-4f05-81b0-9e5882d95711 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:11:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-393029292',display_name='tempest-SnapshotDataIntegrityTests-server-393029292',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-393029292',id=46,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjbbFxV8xRhWT4fIwdXsZ+/BzX7e901Yf3nObtGwz+b+k6E3bkRNGqgPZXxK2j14G0Xitv1U0hdO8uOdH81dx0qUOzfCd2suBB6kYOxQSdlJAAQl4oGIE1AzDKyFwvhpA==',key_name='tempest-keypair-133649445',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:11:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e0d0783bcb5044f7866197a70849f0d3',ramdisk_id='',reservation_id='r-ulbc1vl0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-447747392',owner_user_name='tempest-SnapshotDataIntegrityTests-447747392-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:11:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='adfe8ff94fee434b8df4b38516a94856',uuid=e4d3bac6-de98-4f05-81b0-9e5882d95711,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Converting VIF {"id": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "address": "fa:16:3e:23:f9:19", "network": {"id": "f3c6f947-c14b-4287-a2dd-292fe104905f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-136907957-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e0d0783bcb5044f7866197a70849f0d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e45a9c5-73", "ovs_interfaceid": "1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG os_vif [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e45a9c5-73, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:19:27 user nova-compute[72724]: INFO os_vif [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:f9:19,bridge_name='br-int',has_traffic_filtering=True,id=1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce,network=Network(f3c6f947-c14b-4287-a2dd-292fe104905f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e45a9c5-73')
Aug 17 17:19:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Deleting instance files /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711_del
Aug 17 17:19:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Deletion of /opt/stack/data/nova/instances/e4d3bac6-de98-4f05-81b0-9e5882d95711_del complete
Aug 17 17:19:27 user nova-compute[72724]: INFO nova.compute.manager [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Took 1.03 seconds to destroy the instance on the hypervisor.
Aug 17 17:19:27 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:19:27 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:19:28 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Took 1.03 seconds to deallocate network for instance.
Aug 17 17:19:28 user nova-compute[72724]: DEBUG nova.compute.manager [req-78b0e8d2-1ce5-4f39-a2d1-f86b1f2f6eaf req-bd774c5a-1af5-4260-862c-15394e6f13e2 service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-vif-deleted-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.169s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:29 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Deleted allocations for instance e4d3bac6-de98-4f05-81b0-9e5882d95711
Aug 17 17:19:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-7e170e5c-1bd5-40d9-a3af-e6deb45d8895 req-83e14eff-f882-4d73-9d96-69c89b8a9eaa service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received event network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7e170e5c-1bd5-40d9-a3af-e6deb45d8895 req-83e14eff-f882-4d73-9d96-69c89b8a9eaa service nova] Acquiring lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7e170e5c-1bd5-40d9-a3af-e6deb45d8895 req-83e14eff-f882-4d73-9d96-69c89b8a9eaa service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7e170e5c-1bd5-40d9-a3af-e6deb45d8895 req-83e14eff-f882-4d73-9d96-69c89b8a9eaa service nova] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:29 user nova-compute[72724]: DEBUG nova.compute.manager [req-7e170e5c-1bd5-40d9-a3af-e6deb45d8895 req-83e14eff-f882-4d73-9d96-69c89b8a9eaa service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] No waiting events found dispatching network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:19:29 user nova-compute[72724]: WARNING nova.compute.manager [req-7e170e5c-1bd5-40d9-a3af-e6deb45d8895 req-83e14eff-f882-4d73-9d96-69c89b8a9eaa service nova] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Received unexpected event network-vif-plugged-1e45a9c5-73c6-4be0-b8c9-f1a7e410dcce for instance with vm_state deleted and task_state None.
Aug 17 17:19:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e2ae6776-39cd-4911-8a33-f277f7f81418 tempest-SnapshotDataIntegrityTests-447747392 tempest-SnapshotDataIntegrityTests-447747392-project-member] Lock "e4d3bac6-de98-4f05-81b0-9e5882d95711" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:19:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292767.6705503, e4d3bac6-de98-4f05-81b0-9e5882d95711 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:19:42 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] VM Stopped (Lifecycle Event)
Aug 17 17:19:42 user nova-compute[72724]: DEBUG nova.compute.manager [None req-32ed6d45-499b-4bf8-b252-75cf51d652c8 None None] [instance: e4d3bac6-de98-4f05-81b0-9e5882d95711] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:19:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:19:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:19:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:19:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:19:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:19:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:20:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:20:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:20:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-changed-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:20:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Refreshing instance network info cache due to event network-changed-e585888a-1274-49d5-956d-46968617cc76. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:20:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] Acquiring lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:20:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] Acquired lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:20:08 user nova-compute[72724]: DEBUG nova.network.neutron [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Refreshing network info cache for port e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:09 user nova-compute[72724]: INFO nova.compute.manager [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Terminating instance
Aug 17 17:20:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updated VIF entry in instance network info cache for port e585888a-1274-49d5-956d-46968617cc76. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG nova.network.neutron [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updating instance_info_cache with network_info: [{"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-003b770c-ed66-4a19-9c54-17ec162a0999 req-129cccc3-48de-45ca-8a6c-6bb4e24bd522 service nova] Releasing lock "refresh_cache-37a71c73-bb05-453e-884f-f231cb3a77f9" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-dc520a88-a9ff-4d1a-be1a-165d90fbced6 req-f2eaf60f-da2a-4adc-935d-dd78351c6834 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-vif-unplugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dc520a88-a9ff-4d1a-be1a-165d90fbced6 req-f2eaf60f-da2a-4adc-935d-dd78351c6834 service nova] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dc520a88-a9ff-4d1a-be1a-165d90fbced6 req-f2eaf60f-da2a-4adc-935d-dd78351c6834 service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dc520a88-a9ff-4d1a-be1a-165d90fbced6 req-f2eaf60f-da2a-4adc-935d-dd78351c6834 service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-dc520a88-a9ff-4d1a-be1a-165d90fbced6 req-f2eaf60f-da2a-4adc-935d-dd78351c6834 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] No waiting events found dispatching network-vif-unplugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:20:09 user nova-compute[72724]: DEBUG nova.compute.manager [req-dc520a88-a9ff-4d1a-be1a-165d90fbced6 req-f2eaf60f-da2a-4adc-935d-dd78351c6834 service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-vif-unplugged-e585888a-1274-49d5-956d-46968617cc76 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:20:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Instance destroyed successfully.
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.objects.instance [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'resources' on Instance uuid 37a71c73-bb05-453e-884f-f231cb3a77f9 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:18:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-94087555',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-94087555',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-94087555',id=49,image_ref='5ee08b8e-99dc-4533-9397-1a77e8b92021',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwlnCx3vpsnB2c6kFj5epu+PxbpS0c0nhNod8NFwj65PNg2CA5sWgP+ZNhnMdgrtIuPdg3Wbi+y/IHBic0vwUbVlxqIXuz2L7JD0C43BsE3rrLfj7s8kmZCMNYq7RAqxw==',key_name='tempest-keypair-853186176',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:18:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-d7anx4up',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-924115856',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:18:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=37a71c73-bb05-453e-884f-f231cb3a77f9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "e585888a-1274-49d5-956d-46968617cc76", "address": "fa:16:3e:f3:0e:19", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape585888a-12", "ovs_interfaceid": "e585888a-1274-49d5-956d-46968617cc76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_vif [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape585888a-12, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:10 user nova-compute[72724]: INFO os_vif [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:0e:19,bridge_name='br-int',has_traffic_filtering=True,id=e585888a-1274-49d5-956d-46968617cc76,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape585888a-12')
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HpEUYXJA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:20:10 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c7cda4-b3c8-42f4-be50-532faa301596]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fe5392-d923-4265-a837-25ad13a7f521]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:20:10 user nova-compute[72724]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 (non-flash)
Aug 17 17:20:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:20:10 user nova-compute[72724]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 (non-flash)
Aug 17 17:20:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e811b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa780885-4aa1-4110-914b-db607ce1ef4a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d56a728-afe1-495f-8ab9-2def630e38c3]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bff068e-47da-407e-af2f-2fd6b391c06b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ab1b75-4064-4fbc-9e2b-f4cce9cf1221]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23738373961613137', '/dev/disk/by-id/scsi-1SCST_BIO6733d9d0-7879aa1719f2d772', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_6733d9d0') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed901f62-931c-49ff-96a8-396122abe9e3]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600ba9c-4c91-427b-a843-3d539dc4dc91]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1335d88b-d573-4078-81df-9a06ee1000cd]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260]
Aug 17 17:20:10 user nova-compute[72724]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0, portal: 172.16.0.220,3260] successful.
Aug 17 17:20:10 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b30034a5-7309-411a-8136-fa87065a25a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d280074-0dbe-4043-abaf-0593c5049eac]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== disconnect_volume: return (322ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:20:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Deleting instance files /opt/stack/data/nova/instances/37a71c73-bb05-453e-884f-f231cb3a77f9_del
Aug 17 17:20:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Deletion of /opt/stack/data/nova/instances/37a71c73-bb05-453e-884f-f231cb3a77f9_del complete
Aug 17 17:20:10 user nova-compute[72724]: INFO nova.compute.manager [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 17 17:20:10 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:20:10 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:11 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Took 0.90 seconds to deallocate network for instance.
Aug 17 17:20:11 user nova-compute[72724]: WARNING nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] While synchronizing instance power states, found 2 instances in the database and 1 instances on the hypervisor.
Aug 17 17:20:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 443cd1dc-bf85-4132-be2d-98258f6a3880 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Triggering sync for uuid 37a71c73-bb05-453e-884f-f231cb3a77f9 {{(pid=72724) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] Acquiring lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] No waiting events found dispatching network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:20:12 user nova-compute[72724]: WARNING nova.compute.manager [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received unexpected event network-vif-plugged-e585888a-1274-49d5-956d-46968617cc76 for instance with vm_state active and task_state deleting.
Aug 17 17:20:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-bfe0165e-ee5f-4eda-897c-5edef492b923 req-e5660ffb-fe09-4cfe-bfdb-670fa6eab38e service nova] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Received event network-vif-deleted-e585888a-1274-49d5-956d-46968617cc76 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:12 user nova-compute[72724]: INFO nova.compute.manager [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Took 0.75 seconds to detach 1 volumes for instance.
Aug 17 17:20:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Deleting volume: b30034a5-7309-411a-8136-fa87065a25a0 {{(pid=72724) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.150s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:12 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Deleted allocations for instance 37a71c73-bb05-453e-884f-f231cb3a77f9
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-4e9c841f-0d52-41ff-89c0-04cafd019730 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.214s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.103s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:12 user nova-compute[72724]: INFO nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] During sync_power_state the instance has a pending task (deleting). Skip.
Aug 17 17:20:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "37a71c73-bb05-453e-884f-f231cb3a77f9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:18 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:20 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:20 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:20:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:22 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:20:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:20:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:20:22 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating instance_info_cache with network_info: [{"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-443cd1dc-bf85-4132-be2d-98258f6a3880" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:20:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:20:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:20:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.35769271850586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:20:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 443cd1dc-bf85-4132-be2d-98258f6a3880 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:25 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292810.1772661, 37a71c73-bb05-453e-884f-f231cb3a77f9 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:20:25 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] VM Stopped (Lifecycle Event)
Aug 17 17:20:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3428b153-7fa3-41ba-af80-873163b7c842 None None] [instance: 37a71c73-bb05-453e-884f-f231cb3a77f9] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:20:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:20:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:20:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:20:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:20:35 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:40 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:50 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:20:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:20:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:20:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:20:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:20:55 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:00 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:05 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:06 user nova-compute[72724]: INFO nova.compute.manager [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Terminating instance
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-765d1869-a332-4339-97fe-16ec71a4efc8 req-42fa9a05-a565-46b2-a653-a466d240180c service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-vif-unplugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-765d1869-a332-4339-97fe-16ec71a4efc8 req-42fa9a05-a565-46b2-a653-a466d240180c service nova] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-765d1869-a332-4339-97fe-16ec71a4efc8 req-42fa9a05-a565-46b2-a653-a466d240180c service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-765d1869-a332-4339-97fe-16ec71a4efc8 req-42fa9a05-a565-46b2-a653-a466d240180c service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-765d1869-a332-4339-97fe-16ec71a4efc8 req-42fa9a05-a565-46b2-a653-a466d240180c service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] No waiting events found dispatching network-vif-unplugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.compute.manager [req-765d1869-a332-4339-97fe-16ec71a4efc8 req-42fa9a05-a565-46b2-a653-a466d240180c service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-vif-unplugged-8ee22e41-8639-4c71-9199-fef4d477ad3a for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Instance destroyed successfully.
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'resources' on Instance uuid 443cd1dc-bf85-4132-be2d-98258f6a3880 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1595905060',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1595905060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1595905060',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyfUH3XFcffAO/Gltdv+J4YSl/1++Il7LTp2wj7S/Csb0q/glaCUk3zKv67TuEhik4XNXU28HrF3EI8oRJy2BlhkcdvM6OfW7pu/ZWFyyW44n90Khms7Pz4fkh7szYpug==',key_name='tempest-keypair-641781323',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:16:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-xkgpdw6q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:16:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=443cd1dc-bf85-4132-be2d-98258f6a3880,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "address": "fa:16:3e:0f:ac:85", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8ee22e41-86", "ovs_interfaceid": "8ee22e41-8639-4c71-9199-fef4d477ad3a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG os_vif [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8ee22e41-86, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:06 user nova-compute[72724]: INFO os_vif [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:ac:85,bridge_name='br-int',has_traffic_filtering=True,id=8ee22e41-8639-4c71-9199-fef4d477ad3a,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8ee22e41-86')
Aug 17 17:21:06 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DgXhmUjB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:21:06 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:21:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:06 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bf6a4a-566b-4eb0-87a8-016eea0b5f12]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9deda493-6bed-4471-be90-b4d4904cd703]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:21:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 (non-flash)
Aug 17 17:21:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c85984c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c84b9f-6ae1-4d3b-97f6-facc42c229d7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc9d8ba-03b3-4dd3-9bb7-58638e4ce8fd]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9e5fb9-11df-481b-b47e-162f643eb52d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a67dfe4-35b3-42ce-ab2a-fe99d9546765]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_391b4ad9', '/dev/disk/by-id/scsi-23632623335346430', '/dev/disk/by-id/scsi-1SCST_BIO391b4ad9-62b354d0be39628d') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26f7a8c-ee4a-465c-bf99-b417e0670b9c]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9186bb-8d3a-4b97-ae0d-df7ab378a4a7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e5ea5f-ffd2-4613-92e1-1265bf9e47ab]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260]
Aug 17 17:21:07 user nova-compute[72724]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16, portal: 172.16.0.220,3260] successful.
Aug 17 17:21:07 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1672d882-81a8-40f3-8b67-15933d134e16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7a3d50-ea82-4372-8dbf-f297230ec7c0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== disconnect_volume: return (268ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:21:07 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Deleting instance files /opt/stack/data/nova/instances/443cd1dc-bf85-4132-be2d-98258f6a3880_del
Aug 17 17:21:07 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Deletion of /opt/stack/data/nova/instances/443cd1dc-bf85-4132-be2d-98258f6a3880_del complete
Aug 17 17:21:07 user nova-compute[72724]: INFO nova.compute.manager [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 17 17:21:07 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:21:07 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:21:08 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:21:08 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Took 1.05 seconds to deallocate network for instance.
Aug 17 17:21:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:21:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] Acquiring lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:08 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] No waiting events found dispatching network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:21:08 user nova-compute[72724]: WARNING nova.compute.manager [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received unexpected event network-vif-plugged-8ee22e41-8639-4c71-9199-fef4d477ad3a for instance with vm_state active and task_state deleting.
Aug 17 17:21:08 user nova-compute[72724]: DEBUG nova.compute.manager [req-382b434c-5094-4b5c-902c-c2580ba66d1c req-f2a7c515-28e6-4f50-b3d5-9528c4f6f57d service nova] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Received event network-vif-deleted-8ee22e41-8639-4c71-9199-fef4d477ad3a {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:21:09 user nova-compute[72724]: INFO nova.compute.manager [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Took 0.73 seconds to detach 1 volumes for instance.
Aug 17 17:21:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Deleting volume: 1672d882-81a8-40f3-8b67-15933d134e16 {{(pid=72724) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 17 17:21:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:09 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:21:09 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:21:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.119s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:09 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Deleted allocations for instance 443cd1dc-bf85-4132-be2d-98258f6a3880
Aug 17 17:21:09 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8e7e1763-a151-4c1f-9cc4-722b113ef65d tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "443cd1dc-bf85-4132-be2d-98258f6a3880" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692292866.9319308, 443cd1dc-bf85-4132-be2d-98258f6a3880 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:21:21 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] VM Stopped (Lifecycle Event)
Aug 17 17:21:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-de2ad8f1-8496-4b8a-a75f-c16fe0d8dc79 None None] [instance: 443cd1dc-bf85-4132-be2d-98258f6a3880] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:21:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:21:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:21:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:21:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.356643676757812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:21:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:21:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:21:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:21:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:21:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:21:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:21:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:21:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:21:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:21:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:22:10 user nova-compute[72724]: INFO nova.compute.claims [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Claim successful on node user
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.network.neutron [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:22:10 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:22:10 user nova-compute[72724]: INFO nova.virt.block_device [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Booting with volume a010a161-393d-4976-a9a9-92773c77d0de at /dev/vda
Aug 17 17:22:10 user nova-compute[72724]: DEBUG nova.policy [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e503ef7b08034c8ea4135912c91d9c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c38413cbee44af48869f91b661b1333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG os_brick.utils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:22:10 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3411d72-6f77-4d43-bc53-a364bf390e2b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9735c5-d311-43f4-a52b-bf91c0d2c926]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bfe72d-05de-4d67-8215-27d9c86dccc0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b640be-764a-4001-a0b8-22cb69a70eca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:22:11 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:22:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[83008a22-8233-4362-a341-c8f8edd3dc32]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG os_brick.utils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updating existing volume attachment record: 3033c8b4-dac2-48d5-95c0-79c97d93c4a9 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:22:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Successfully created port: a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Successfully updated port: a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquired lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-changed-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG nova.compute.manager [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Refreshing instance network info cache due to event network-changed-a2ebc688-b603-4c01-9fc3-43cf9a43087b. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] Acquiring lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:22:12 user nova-compute[72724]: DEBUG nova.network.neutron [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG nova.network.neutron [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updating instance_info_cache with network_info: [{"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Releasing lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Instance network_info: |[{"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] Acquired lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG nova.network.neutron [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Refreshing network info cache for port a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG nova.network.neutron [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updated VIF entry in instance network info cache for port a2ebc688-b603-4c01-9fc3-43cf9a43087b. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG nova.network.neutron [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updating instance_info_cache with network_info: [{"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:22:13 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-43db5822-25f4-49ae-ba03-38ba2056bc0f req-84a6bca9-a329-4202-a01e-75c4d0ecf64e service nova] Releasing lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:22:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:22:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:22:21 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Creating image(s)
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Ensure instance console log exists: /opt/stack/data/nova/instances/8916434a-f520-4f8d-a83c-5c0561c98f43/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Start _get_guest_xml network_info=[{"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3033c8b4-dac2-48d5-95c0-79c97d93c4a9', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8916434a-f520-4f8d-a83c-5c0561c98f43', 'attached_at': '', 'detached_at': '', 'volume_id': 'a010a161-393d-4976-a9a9-92773c77d0de', 'serial': 'a010a161-393d-4976-a9a9-92773c77d0de'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:22:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:22:21 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:22:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:22:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:22:21 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bfaaa6-5243-4d01-992a-00fd479d5bcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:22:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31e1bde-27c3-444d-b466-7c064b45f8a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de] added
Aug 17 17:22:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[583c20c7-2d31-4abf-89b0-e7bf23d86ece]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b710c-4c30-40b8-86a4-cc36b4f0969e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzNtXGhc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzNtXGhc" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[582fb809-2f0d-404c-8e67-343203e3277b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzNtXGhc'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f3760-2c94-4fac-abd8-8980ef8cadef]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[07224404-0a02-4f4e-9a15-f1641264a747]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:22:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:22:21 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:22:21 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:22:21 user nova-compute[72724]: 
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec1fea5-4a77-428e-a3ac-d62f9dfa9872]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]
Aug 17 17:22:21 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.
Aug 17 17:22:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bc556d-7ca1-46cc-8b4c-24fa5beaa868]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[229756dd-9c08-4197-ab45-315f29c4c82b]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:22:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:22:21 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bdfbcb-618f-448c-8fa4-f67c92c29da9]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:22:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:22 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.542s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== connect_volume: return (1543ms) {'type': 'block', 'scsi_wwn': '23466363536616361', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466363536616361', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:22:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:22:23 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8964MB free_disk=25.347301483154297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1287203174',display_name='tempest-TestVolumeBootPattern-server-1287203174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1287203174',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-5d06p6at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:22:11Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=8916434a-f520-4f8d-a83c-5c0561c98f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.objects.instance [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'pci_devices' on Instance uuid 8916434a-f520-4f8d-a83c-5c0561c98f43 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:22:23 user nova-compute[72724]:   <uuid>8916434a-f520-4f8d-a83c-5c0561c98f43</uuid>
Aug 17 17:22:23 user nova-compute[72724]:   <name>instance-00000032</name>
Aug 17 17:22:23 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:22:23 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:22:23 user nova-compute[72724]:   <metadata>
Aug 17 17:22:23 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:22:23 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:22:23 user nova-compute[72724]:       <nova:name>tempest-TestVolumeBootPattern-server-1287203174</nova:name>
Aug 17 17:22:23 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:22:21</nova:creationTime>
Aug 17 17:22:23 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:22:23 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:22:23 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:22:23 user nova-compute[72724]:       <nova:owner>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:user uuid="e503ef7b08034c8ea4135912c91d9c0f">tempest-TestVolumeBootPattern-924115856-project-member</nova:user>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:project uuid="0c38413cbee44af48869f91b661b1333">tempest-TestVolumeBootPattern-924115856</nova:project>
Aug 17 17:22:23 user nova-compute[72724]:       </nova:owner>
Aug 17 17:22:23 user nova-compute[72724]:       <nova:ports>
Aug 17 17:22:23 user nova-compute[72724]:         <nova:port uuid="a2ebc688-b603-4c01-9fc3-43cf9a43087b">
Aug 17 17:22:23 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 17:22:23 user nova-compute[72724]:         </nova:port>
Aug 17 17:22:23 user nova-compute[72724]:       </nova:ports>
Aug 17 17:22:23 user nova-compute[72724]:     </nova:instance>
Aug 17 17:22:23 user nova-compute[72724]:   </metadata>
Aug 17 17:22:23 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:22:23 user nova-compute[72724]:     <system>
Aug 17 17:22:23 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:22:23 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:22:23 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:22:23 user nova-compute[72724]:       <entry name="serial">8916434a-f520-4f8d-a83c-5c0561c98f43</entry>
Aug 17 17:22:23 user nova-compute[72724]:       <entry name="uuid">8916434a-f520-4f8d-a83c-5c0561c98f43</entry>
Aug 17 17:22:23 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:22:23 user nova-compute[72724]:     </system>
Aug 17 17:22:23 user nova-compute[72724]:   </sysinfo>
Aug 17 17:22:23 user nova-compute[72724]:   <os>
Aug 17 17:22:23 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:22:23 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:22:23 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:22:23 user nova-compute[72724]:   </os>
Aug 17 17:22:23 user nova-compute[72724]:   <features>
Aug 17 17:22:23 user nova-compute[72724]:     <acpi/>
Aug 17 17:22:23 user nova-compute[72724]:     <apic/>
Aug 17 17:22:23 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:22:23 user nova-compute[72724]:   </features>
Aug 17 17:22:23 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:22:23 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:22:23 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:22:23 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:22:23 user nova-compute[72724]:   </clock>
Aug 17 17:22:23 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:22:23 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:22:23 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:22:23 user nova-compute[72724]:   </cpu>
Aug 17 17:22:23 user nova-compute[72724]:   <devices>
Aug 17 17:22:23 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 17:22:23 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:22:23 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 17:22:23 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:22:23 user nova-compute[72724]:       <serial>a010a161-393d-4976-a9a9-92773c77d0de</serial>
Aug 17 17:22:23 user nova-compute[72724]:     </disk>
Aug 17 17:22:23 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:22:23 user nova-compute[72724]:       <mac address="fa:16:3e:fa:22:af"/>
Aug 17 17:22:23 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:22:23 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:22:23 user nova-compute[72724]:       <target dev="tapa2ebc688-b6"/>
Aug 17 17:22:23 user nova-compute[72724]:     </interface>
Aug 17 17:22:23 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:22:23 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/8916434a-f520-4f8d-a83c-5c0561c98f43/console.log" append="off"/>
Aug 17 17:22:23 user nova-compute[72724]:     </serial>
Aug 17 17:22:23 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:22:23 user nova-compute[72724]:     <video>
Aug 17 17:22:23 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:22:23 user nova-compute[72724]:     </video>
Aug 17 17:22:23 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:22:23 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:22:23 user nova-compute[72724]:     </rng>
Aug 17 17:22:23 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:22:23 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:22:23 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:22:23 user nova-compute[72724]:     </memballoon>
Aug 17 17:22:23 user nova-compute[72724]:   </devices>
Aug 17 17:22:23 user nova-compute[72724]: </domain>
Aug 17 17:22:23 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1287203174',display_name='tempest-TestVolumeBootPattern-server-1287203174',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1287203174',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-5d06p6at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:22:11Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=8916434a-f520-4f8d-a83c-5c0561c98f43,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG os_vif [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2ebc688-b6, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa2ebc688-b6, col_values=(('external_ids', {'iface-id': 'a2ebc688-b603-4c01-9fc3-43cf9a43087b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:22:af', 'vm-uuid': '8916434a-f520-4f8d-a83c-5c0561c98f43'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:23 user nova-compute[72724]: INFO os_vif [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6')
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8916434a-f520-4f8d-a83c-5c0561c98f43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No VIF found with MAC fa:16:3e:fa:22:af, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:22:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-b1fe8b9e-29d3-40ee-b0ae-139190223f7a req-6701e776-fd4d-495e-bce8-4f8ee09bc790 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b1fe8b9e-29d3-40ee-b0ae-139190223f7a req-6701e776-fd4d-495e-bce8-4f8ee09bc790 service nova] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b1fe8b9e-29d3-40ee-b0ae-139190223f7a req-6701e776-fd4d-495e-bce8-4f8ee09bc790 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b1fe8b9e-29d3-40ee-b0ae-139190223f7a req-6701e776-fd4d-495e-bce8-4f8ee09bc790 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [req-b1fe8b9e-29d3-40ee-b0ae-139190223f7a req-6701e776-fd4d-495e-bce8-4f8ee09bc790 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] No waiting events found dispatching network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:22:24 user nova-compute[72724]: WARNING nova.compute.manager [req-b1fe8b9e-29d3-40ee-b0ae-139190223f7a req-6701e776-fd4d-495e-bce8-4f8ee09bc790 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received unexpected event network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b for instance with vm_state building and task_state spawning.
Aug 17 17:22:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Skipping network cache update for instance because it is Building. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 17 17:22:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:22:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:25 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292946.5138948, 8916434a-f520-4f8d-a83c-5c0561c98f43 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] VM Resumed (Lifecycle Event)
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Instance spawned successfully.
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692292946.5151014, 8916434a-f520-4f8d-a83c-5c0561c98f43 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] VM Started (Lifecycle Event)
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Took 5.14 seconds to spawn the instance on the hypervisor.
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:22:26 user nova-compute[72724]: INFO nova.compute.manager [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Took 16.15 seconds to build instance.
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-d8f804ce-3966-4a75-bcc5-160605bf1bc7 req-791255e5-5a81-43a9-9099-99fc4c061bf6 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d8f804ce-3966-4a75-bcc5-160605bf1bc7 req-791255e5-5a81-43a9-9099-99fc4c061bf6 service nova] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d8f804ce-3966-4a75-bcc5-160605bf1bc7 req-791255e5-5a81-43a9-9099-99fc4c061bf6 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d8f804ce-3966-4a75-bcc5-160605bf1bc7 req-791255e5-5a81-43a9-9099-99fc4c061bf6 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:26 user nova-compute[72724]: DEBUG nova.compute.manager [req-d8f804ce-3966-4a75-bcc5-160605bf1bc7 req-791255e5-5a81-43a9-9099-99fc4c061bf6 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] No waiting events found dispatching network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:22:26 user nova-compute[72724]: WARNING nova.compute.manager [req-d8f804ce-3966-4a75-bcc5-160605bf1bc7 req-791255e5-5a81-43a9-9099-99fc4c061bf6 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received unexpected event network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b for instance with vm_state active and task_state None.
Aug 17 17:22:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-90e9b08d-a7d6-4dcb-b8b1-839699e0ca65 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.263s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:22:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:22:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:22:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:22:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:23:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:23:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:23:23 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:23:24 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:23:24 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8812MB free_disk=25.346050262451172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 8916434a-f520-4f8d-a83c-5c0561c98f43 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.635s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:23:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:23:25 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 8916434a-f520-4f8d-a83c-5c0561c98f43 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updating instance_info_cache with network_info: [{"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:26 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:23:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:23:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:23:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:57 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:23:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:23:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:23:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-changed-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Refreshing instance network info cache due to event network-changed-a2ebc688-b603-4c01-9fc3-43cf9a43087b. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] Acquiring lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] Acquired lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG nova.network.neutron [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Refreshing network info cache for port a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG nova.network.neutron [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updated VIF entry in instance network info cache for port a2ebc688-b603-4c01-9fc3-43cf9a43087b. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG nova.network.neutron [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updating instance_info_cache with network_info: [{"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-d80b59a2-6969-4b1c-92d9-cd5e93bbc224 req-8b1c2913-ea34-47f5-9961-2f85344ed193 service nova] Releasing lock "refresh_cache-8916434a-f520-4f8d-a83c-5c0561c98f43" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:02 user nova-compute[72724]: INFO nova.compute.manager [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Terminating instance
Aug 17 17:24:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:24:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-aab40a28-e8ea-48c8-852c-c64331d1514a req-6ad17921-1fc4-4775-ae51-c47cab875854 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-vif-unplugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-aab40a28-e8ea-48c8-852c-c64331d1514a req-6ad17921-1fc4-4775-ae51-c47cab875854 service nova] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-aab40a28-e8ea-48c8-852c-c64331d1514a req-6ad17921-1fc4-4775-ae51-c47cab875854 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-aab40a28-e8ea-48c8-852c-c64331d1514a req-6ad17921-1fc4-4775-ae51-c47cab875854 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-aab40a28-e8ea-48c8-852c-c64331d1514a req-6ad17921-1fc4-4775-ae51-c47cab875854 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] No waiting events found dispatching network-vif-unplugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.compute.manager [req-aab40a28-e8ea-48c8-852c-c64331d1514a req-6ad17921-1fc4-4775-ae51-c47cab875854 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-vif-unplugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Instance destroyed successfully.
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.objects.instance [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'resources' on Instance uuid 8916434a-f520-4f8d-a83c-5c0561c98f43 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:22:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1287203174',display_name='tempest-TestVolumeBootPattern-server-1287203174',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1287203174',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:22:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-5d06p6at',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:22:27Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=8916434a-f520-4f8d-a83c-5c0561c98f43,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "address": "fa:16:3e:fa:22:af", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2ebc688-b6", "ovs_interfaceid": "a2ebc688-b603-4c01-9fc3-43cf9a43087b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_vif [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2ebc688-b6, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:24:03 user nova-compute[72724]: INFO os_vif [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:22:af,bridge_name='br-int',has_traffic_filtering=True,id=a2ebc688-b603-4c01-9fc3-43cf9a43087b,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2ebc688-b6')
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:24:03 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b51bfdf-b33d-4208-bfc3-bd82f6b63d91]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbaddad-76ad-4634-a18c-eb1814d071ab]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:24:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:24:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81bd480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e47fa8d-70a1-4e55-9374-feb77f04b47c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7aca62-4630-4b85-86c5-1fda29743e18]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b081043b-a5a9-4f08-bcea-587de62fc996]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4bbae9-788e-4445-ba66-1506a7f1bf10]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_900e9fdb', '/dev/disk/by-id/scsi-1SCST_BIO900e9fdb-4f656acac0d0f657', '/dev/disk/by-id/scsi-23466363536616361') {{(pid=83733) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[63184886-28dc-4eeb-bfc0-27a04c71ddc3]: (4, None) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda45c20-43ef-4610-8045-650b27d36df2]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ed916e-84b1-474a-9806-6eaf8ab53105]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]
Aug 17 17:24:03 user nova-compute[72724]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.
Aug 17 17:24:03 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd38773a-1761-490d-a11d-d43e99751211]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== disconnect_volume: return (258ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:24:03 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:24:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Deleting instance files /opt/stack/data/nova/instances/8916434a-f520-4f8d-a83c-5c0561c98f43_del
Aug 17 17:24:03 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Deletion of /opt/stack/data/nova/instances/8916434a-f520-4f8d-a83c-5c0561c98f43_del complete
Aug 17 17:24:04 user nova-compute[72724]: INFO nova.compute.manager [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Took 1.10 seconds to destroy the instance on the hypervisor.
Aug 17 17:24:04 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:24:04 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:24:04 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:24:04 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:24:04 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Took 0.76 seconds to deallocate network for instance.
Aug 17 17:24:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] Acquiring lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] No waiting events found dispatching network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:24:05 user nova-compute[72724]: WARNING nova.compute.manager [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received unexpected event network-vif-plugged-a2ebc688-b603-4c01-9fc3-43cf9a43087b for instance with vm_state active and task_state deleting.
Aug 17 17:24:05 user nova-compute[72724]: DEBUG nova.compute.manager [req-e428e7d7-2d74-4996-9d14-9e85ca051410 req-b774cbd2-9cfb-479d-9f0d-cb79c26ce724 service nova] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Received event network-vif-deleted-a2ebc688-b603-4c01-9fc3-43cf9a43087b {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:24:05 user nova-compute[72724]: INFO nova.compute.manager [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Took 0.77 seconds to detach 1 volumes for instance.
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.175s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:05 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Deleted allocations for instance 8916434a-f520-4f8d-a83c-5c0561c98f43
Aug 17 17:24:05 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-69dec431-710a-40f2-b13a-6b60c60e8ba6 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "8916434a-f520-4f8d-a83c-5c0561c98f43" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.978s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:18 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692293043.6772106, 8916434a-f520-4f8d-a83c-5c0561c98f43 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:24:18 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] VM Stopped (Lifecycle Event)
Aug 17 17:24:18 user nova-compute[72724]: DEBUG nova.compute.manager [None req-082dfcb9-6e22-44c8-b8a5-4b0854aa92a9 None None] [instance: 8916434a-f520-4f8d-a83c-5c0561c98f43] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:24:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:24:20 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:23 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:23 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:24:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:24 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:24:24 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.34520721435547GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:24:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.264s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:24:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:24:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:24:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:24:54 user nova-compute[72724]: INFO nova.compute.claims [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Claim successful on node user
Aug 17 17:24:54 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:24:54 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.183s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:24:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:24:55 user nova-compute[72724]: INFO nova.virt.block_device [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Booting with volume a010a161-393d-4976-a9a9-92773c77d0de at /dev/vda
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.policy [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e503ef7b08034c8ea4135912c91d9c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c38413cbee44af48869f91b661b1333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG os_brick.utils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f81e58-14f9-47d4-a4f1-a47ca8786e61]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2547321-b9e7-48c7-ab4a-d42e6a1cb175]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd16266-c397-4376-a7a7-21b06a162107]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[39debd30-1869-4ac3-8c8f-bdb9042b0302]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:24:55 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:24:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0130d9-71a0-4319-b483-cc30c2e681a2]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG os_brick.utils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating existing volume attachment record: 6bbf5cbc-ad4d-4fad-97b7-e4e6cadffa2e {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:24:55 user nova-compute[72724]: DEBUG nova.network.neutron [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Successfully created port: edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Successfully updated port: edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-changed-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Refreshing instance network info cache due to event network-changed-edcaddbe-ca1d-4dce-9761-8d3e86cb7720. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:24:56 user nova-compute[72724]: DEBUG nova.network.neutron [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG nova.network.neutron [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Instance network_info: |[{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG nova.network.neutron [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Refreshing network info cache for port edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG nova.network.neutron [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated VIF entry in instance network info cache for port edcaddbe-ca1d-4dce-9761-8d3e86cb7720. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG nova.network.neutron [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:24:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f537e44d-a28a-4296-af85-18fd6cc0c5d1 req-43262b41-155b-4f7b-8282-92f5b6962dd3 service nova] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:24:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:25:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:25:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:25:12 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Creating image(s)
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Ensure instance console log exists: /opt/stack/data/nova/instances/13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Start _get_guest_xml network_info=[{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6bbf5cbc-ad4d-4fad-97b7-e4e6cadffa2e', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6', 'attached_at': '', 'detached_at': '', 'volume_id': 'a010a161-393d-4976-a9a9-92773c77d0de', 'serial': 'a010a161-393d-4976-a9a9-92773c77d0de'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:25:12 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:25:12 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:25:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:25:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:25:12 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7295ad1b-762b-4ccf-aec1-33131ccfb041]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:25:12 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d9a468-4951-4944-8921-a491d673e0bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de] added
Aug 17 17:25:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[555ddc3c-bb75-48b2-a9e6-2020768df30b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f57edeb-4da6-4066-8b9c-a4a85c25d67d]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzNtXGhc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RzNtXGhc" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadea61d-5b35-4b14-b934-67fce49715ed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RzNtXGhc'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f5eb21-cef6-4952-b23e-632cfd4a1316]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b939579f-b58e-48b4-93b3-b2b6a2671043]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:25:12 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:25:12 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:25:12 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:25:12 user nova-compute[72724]: 
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ca0808-de79-4915-9ba8-eaf2ec0246f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]
Aug 17 17:25:12 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.
Aug 17 17:25:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f86b7df-39cf-47dc-9e26-07ebc867876c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf00194c-325d-4c8c-87e6-2df2c575f46a]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:25:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:25:12 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39b5699-5416-4160-9158-2ce07fef46dc]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:25:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '23466363536616361', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466363536616361', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1103205548',display_name='tempest-TestVolumeBootPattern-server-1103205548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1103205548',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-vmno7c6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:24:55Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.objects.instance [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'pci_devices' on Instance uuid 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:25:13 user nova-compute[72724]:   <uuid>13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6</uuid>
Aug 17 17:25:13 user nova-compute[72724]:   <name>instance-00000033</name>
Aug 17 17:25:13 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:25:13 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:25:13 user nova-compute[72724]:   <metadata>
Aug 17 17:25:13 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:25:13 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:25:13 user nova-compute[72724]:       <nova:name>tempest-TestVolumeBootPattern-server-1103205548</nova:name>
Aug 17 17:25:13 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:25:12</nova:creationTime>
Aug 17 17:25:13 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:25:13 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:25:13 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:25:13 user nova-compute[72724]:       <nova:owner>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:user uuid="e503ef7b08034c8ea4135912c91d9c0f">tempest-TestVolumeBootPattern-924115856-project-member</nova:user>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:project uuid="0c38413cbee44af48869f91b661b1333">tempest-TestVolumeBootPattern-924115856</nova:project>
Aug 17 17:25:13 user nova-compute[72724]:       </nova:owner>
Aug 17 17:25:13 user nova-compute[72724]:       <nova:ports>
Aug 17 17:25:13 user nova-compute[72724]:         <nova:port uuid="edcaddbe-ca1d-4dce-9761-8d3e86cb7720">
Aug 17 17:25:13 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 17 17:25:13 user nova-compute[72724]:         </nova:port>
Aug 17 17:25:13 user nova-compute[72724]:       </nova:ports>
Aug 17 17:25:13 user nova-compute[72724]:     </nova:instance>
Aug 17 17:25:13 user nova-compute[72724]:   </metadata>
Aug 17 17:25:13 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:25:13 user nova-compute[72724]:     <system>
Aug 17 17:25:13 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:25:13 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:25:13 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:25:13 user nova-compute[72724]:       <entry name="serial">13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6</entry>
Aug 17 17:25:13 user nova-compute[72724]:       <entry name="uuid">13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6</entry>
Aug 17 17:25:13 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:25:13 user nova-compute[72724]:     </system>
Aug 17 17:25:13 user nova-compute[72724]:   </sysinfo>
Aug 17 17:25:13 user nova-compute[72724]:   <os>
Aug 17 17:25:13 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:25:13 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:25:13 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:25:13 user nova-compute[72724]:   </os>
Aug 17 17:25:13 user nova-compute[72724]:   <features>
Aug 17 17:25:13 user nova-compute[72724]:     <acpi/>
Aug 17 17:25:13 user nova-compute[72724]:     <apic/>
Aug 17 17:25:13 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:25:13 user nova-compute[72724]:   </features>
Aug 17 17:25:13 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:25:13 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:25:13 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:25:13 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:25:13 user nova-compute[72724]:   </clock>
Aug 17 17:25:13 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:25:13 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:25:13 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:25:13 user nova-compute[72724]:   </cpu>
Aug 17 17:25:13 user nova-compute[72724]:   <devices>
Aug 17 17:25:13 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 17:25:13 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:25:13 user nova-compute[72724]:       <source dev="/dev/sdb"/>
Aug 17 17:25:13 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:25:13 user nova-compute[72724]:       <serial>a010a161-393d-4976-a9a9-92773c77d0de</serial>
Aug 17 17:25:13 user nova-compute[72724]:     </disk>
Aug 17 17:25:13 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:25:13 user nova-compute[72724]:       <mac address="fa:16:3e:3c:0a:f4"/>
Aug 17 17:25:13 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:25:13 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:25:13 user nova-compute[72724]:       <target dev="tapedcaddbe-ca"/>
Aug 17 17:25:13 user nova-compute[72724]:     </interface>
Aug 17 17:25:13 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:25:13 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6/console.log" append="off"/>
Aug 17 17:25:13 user nova-compute[72724]:     </serial>
Aug 17 17:25:13 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:25:13 user nova-compute[72724]:     <video>
Aug 17 17:25:13 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:25:13 user nova-compute[72724]:     </video>
Aug 17 17:25:13 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:25:13 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:25:13 user nova-compute[72724]:     </rng>
Aug 17 17:25:13 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:25:13 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:25:13 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:25:13 user nova-compute[72724]:     </memballoon>
Aug 17 17:25:13 user nova-compute[72724]:   </devices>
Aug 17 17:25:13 user nova-compute[72724]: </domain>
Aug 17 17:25:13 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1103205548',display_name='tempest-TestVolumeBootPattern-server-1103205548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1103205548',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-vmno7c6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:24:55Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG os_vif [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedcaddbe-ca, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapedcaddbe-ca, col_values=(('external_ids', {'iface-id': 'edcaddbe-ca1d-4dce-9761-8d3e86cb7720', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:0a:f4', 'vm-uuid': '13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:13 user nova-compute[72724]: INFO os_vif [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca')
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:25:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No VIF found with MAC fa:16:3e:3c:0a:f4, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f6e1dd47-f099-4cc3-9235-9b23557a5e3c req-523a5614-75bd-4efc-9d78-99d0857e8f99 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f6e1dd47-f099-4cc3-9235-9b23557a5e3c req-523a5614-75bd-4efc-9d78-99d0857e8f99 service nova] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f6e1dd47-f099-4cc3-9235-9b23557a5e3c req-523a5614-75bd-4efc-9d78-99d0857e8f99 service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-f6e1dd47-f099-4cc3-9235-9b23557a5e3c req-523a5614-75bd-4efc-9d78-99d0857e8f99 service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG nova.compute.manager [req-f6e1dd47-f099-4cc3-9235-9b23557a5e3c req-523a5614-75bd-4efc-9d78-99d0857e8f99 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] No waiting events found dispatching network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:25:15 user nova-compute[72724]: WARNING nova.compute.manager [req-f6e1dd47-f099-4cc3-9235-9b23557a5e3c req-523a5614-75bd-4efc-9d78-99d0857e8f99 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received unexpected event network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 for instance with vm_state building and task_state spawning.
Aug 17 17:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:15 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692293117.0158422, 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] VM Resumed (Lifecycle Event)
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Instance spawned successfully.
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692293117.0207038, 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] VM Started (Lifecycle Event)
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Took 4.85 seconds to spawn the instance on the hypervisor.
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:25:17 user nova-compute[72724]: INFO nova.compute.manager [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Took 22.43 seconds to build instance.
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c39b25f-1973-43ac-889a-39105cde77c9 req-1b20c6d5-68da-44d6-bd4c-1a7a26e8280c service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c39b25f-1973-43ac-889a-39105cde77c9 req-1b20c6d5-68da-44d6-bd4c-1a7a26e8280c service nova] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c39b25f-1973-43ac-889a-39105cde77c9 req-1b20c6d5-68da-44d6-bd4c-1a7a26e8280c service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-9c39b25f-1973-43ac-889a-39105cde77c9 req-1b20c6d5-68da-44d6-bd4c-1a7a26e8280c service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG nova.compute.manager [req-9c39b25f-1973-43ac-889a-39105cde77c9 req-1b20c6d5-68da-44d6-bd4c-1a7a26e8280c service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] No waiting events found dispatching network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:25:17 user nova-compute[72724]: WARNING nova.compute.manager [req-9c39b25f-1973-43ac-889a-39105cde77c9 req-1b20c6d5-68da-44d6-bd4c-1a7a26e8280c service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received unexpected event network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 for instance with vm_state active and task_state None.
Aug 17 17:25:17 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-82597f35-07ea-422c-b9da-0a7da794298b tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.526s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:25:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:22 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:25:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:25:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:25:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.343605041503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:25:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:25:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:25:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:25:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:26:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:26:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:26:23 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:26:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:26:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:26:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.34292984008789GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:26:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:26:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:27 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:26:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:26:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:26:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:26:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:26:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:26:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:26:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:45 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-changed-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:26:46 user nova-compute[72724]: DEBUG nova.compute.manager [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Refreshing instance network info cache due to event network-changed-edcaddbe-ca1d-4dce-9761-8d3e86cb7720. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:26:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:26:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:26:46 user nova-compute[72724]: DEBUG nova.network.neutron [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Refreshing network info cache for port edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:26:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated VIF entry in instance network info cache for port edcaddbe-ca1d-4dce-9761-8d3e86cb7720. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:26:47 user nova-compute[72724]: DEBUG nova.network.neutron [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:26:47 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-3dfc61f6-072b-46c4-92b0-4d735b069859 req-aeb9bfba-e386-4b88-9f75-9195d15c5d09 service nova] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:26:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:26:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "b167a400-9be9-4980-9503-275b311f4794" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:27:00 user nova-compute[72724]: INFO nova.compute.claims [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Claim successful on node user
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:27:00 user nova-compute[72724]: DEBUG nova.network.neutron [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:27:00 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:27:01 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:27:01 user nova-compute[72724]: INFO nova.virt.block_device [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Booting with volume 6556f2e8-0a56-4a65-b5c7-5fda875f301d at /dev/vda
Aug 17 17:27:01 user nova-compute[72724]: DEBUG nova.policy [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e503ef7b08034c8ea4135912c91d9c0f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c38413cbee44af48869f91b661b1333', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG os_brick.utils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e604d48a-77a2-4dae-b724-5c358868b4f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3fd93b-5c1b-45a4-9c38-69ca5f227646]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63e87ae-1ebc-48ab-b590-744c775c039a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[64178761-d0b5-4f73-a1af-fc2c429cd23b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:27:01 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:27:01 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1824aa-d092-4ade-80ea-b71e0dfc5532]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG os_brick.utils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating existing volume attachment record: b857f9e5-cb58-4e86-87ce-8f75b650d02c {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:27:01 user nova-compute[72724]: DEBUG nova.network.neutron [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Successfully created port: c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Successfully updated port: c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquired lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-changed-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.compute.manager [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Refreshing instance network info cache due to event network-changed-c43669d2-c1ed-4fe4-8000-524e47b8adfd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] Acquiring lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.network.neutron [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating instance_info_cache with network_info: [{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Releasing lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Instance network_info: |[{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] Acquired lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:27:02 user nova-compute[72724]: DEBUG nova.network.neutron [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Refreshing network info cache for port c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:27:03 user nova-compute[72724]: DEBUG nova.network.neutron [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Updated VIF entry in instance network info cache for port c43669d2-c1ed-4fe4-8000-524e47b8adfd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:27:03 user nova-compute[72724]: DEBUG nova.network.neutron [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating instance_info_cache with network_info: [{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:27:03 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-0000cd6e-f7a6-4824-bf81-6f44453d738e req-4dfa54e4-3272-4451-8340-8e201778d422 service nova] Releasing lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:27:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:27:11 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Creating image(s)
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Did not create local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Ensure instance console log exists: /opt/stack/data/nova/instances/b167a400-9be9-4980-9503-275b311f4794/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Start _get_guest_xml network_info=[{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'b857f9e5-cb58-4e86-87ce-8f75b650d02c', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZAiahTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b167a400-9be9-4980-9503-275b311f4794', 'attached_at': '', 'detached_at': '', 'volume_id': '6556f2e8-0a56-4a65-b5c7-5fda875f301d', 'serial': '6556f2e8-0a56-4a65-b5c7-5fda875f301d'}, 'device_type': 'disk', 'disk_bus': 'virtio', 'delete_on_termination': False, 'guest_format': None, 'boot_index': 0, 'volume_type': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:27:11 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:27:11 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZAiahTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:27:11 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:27:11 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:27:11 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec0757-1417-46b1-9585-f4430f964b67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:27:11 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f31da1-62cf-4e4a-89d5-0e894468b7a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d] added
Aug 17 17:27:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8728be5-7d48-4d66-b5af-050572fa5b8e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d747d8d-7015-410a-825d-d6f09c5e6e94]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZAiahTk {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dZAiahTk" returned: 0 in 0.027s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6975fa09-4d34-4726-af4d-547a5c93803b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dZAiahTk'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8b1df8-7807-4c0e-831d-7ec2fd9cba9b]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b6f53a-fc4a-4615-ba9c-1653688e9583]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:27:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:27:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b995f124-ca5a-41f4-bf00-e5e2d7a7bf45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260]
Aug 17 17:27:11 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260] successful.
Aug 17 17:27:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2f2b2a-7bf1-4bb8-8f36-722b543755cd]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aac2f93-a4ef-4e45-880e-0217234b274b]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:27:11 user nova-compute[72724]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d (non-flash)
Aug 17 17:27:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:27:11 user nova-compute[72724]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d (non-flash)
Aug 17 17:27:11 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c1437b-89b7-48db-a79a-19d8b2ee08dd]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:27:11 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZAiahTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26536316661363033', 'path': '/dev/sdc'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536316661363033', 'path': '/dev/sdc'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-4292723',display_name='tempest-TestVolumeBootPattern-server-4292723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-4292723',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-gttdmws9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:27:01Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=b167a400-9be9-4980-9503-275b311f4794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:27:12 user nova-compute[72724]: DEBUG nova.objects.instance [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'pci_devices' on Instance uuid b167a400-9be9-4980-9503-275b311f4794 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:27:13 user nova-compute[72724]:   <uuid>b167a400-9be9-4980-9503-275b311f4794</uuid>
Aug 17 17:27:13 user nova-compute[72724]:   <name>instance-00000034</name>
Aug 17 17:27:13 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:27:13 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:27:13 user nova-compute[72724]:   <metadata>
Aug 17 17:27:13 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:27:13 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:27:13 user nova-compute[72724]:       <nova:name>tempest-TestVolumeBootPattern-server-4292723</nova:name>
Aug 17 17:27:13 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:27:11</nova:creationTime>
Aug 17 17:27:13 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:27:13 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:27:13 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:27:13 user nova-compute[72724]:       <nova:owner>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:user uuid="e503ef7b08034c8ea4135912c91d9c0f">tempest-TestVolumeBootPattern-924115856-project-member</nova:user>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:project uuid="0c38413cbee44af48869f91b661b1333">tempest-TestVolumeBootPattern-924115856</nova:project>
Aug 17 17:27:13 user nova-compute[72724]:       </nova:owner>
Aug 17 17:27:13 user nova-compute[72724]:       <nova:ports>
Aug 17 17:27:13 user nova-compute[72724]:         <nova:port uuid="c43669d2-c1ed-4fe4-8000-524e47b8adfd">
Aug 17 17:27:13 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 17 17:27:13 user nova-compute[72724]:         </nova:port>
Aug 17 17:27:13 user nova-compute[72724]:       </nova:ports>
Aug 17 17:27:13 user nova-compute[72724]:     </nova:instance>
Aug 17 17:27:13 user nova-compute[72724]:   </metadata>
Aug 17 17:27:13 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:27:13 user nova-compute[72724]:     <system>
Aug 17 17:27:13 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:27:13 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:27:13 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:27:13 user nova-compute[72724]:       <entry name="serial">b167a400-9be9-4980-9503-275b311f4794</entry>
Aug 17 17:27:13 user nova-compute[72724]:       <entry name="uuid">b167a400-9be9-4980-9503-275b311f4794</entry>
Aug 17 17:27:13 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:27:13 user nova-compute[72724]:     </system>
Aug 17 17:27:13 user nova-compute[72724]:   </sysinfo>
Aug 17 17:27:13 user nova-compute[72724]:   <os>
Aug 17 17:27:13 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:27:13 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:27:13 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:27:13 user nova-compute[72724]:   </os>
Aug 17 17:27:13 user nova-compute[72724]:   <features>
Aug 17 17:27:13 user nova-compute[72724]:     <acpi/>
Aug 17 17:27:13 user nova-compute[72724]:     <apic/>
Aug 17 17:27:13 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:27:13 user nova-compute[72724]:   </features>
Aug 17 17:27:13 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:27:13 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:27:13 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:27:13 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:27:13 user nova-compute[72724]:   </clock>
Aug 17 17:27:13 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:27:13 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:27:13 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:27:13 user nova-compute[72724]:   </cpu>
Aug 17 17:27:13 user nova-compute[72724]:   <devices>
Aug 17 17:27:13 user nova-compute[72724]:     <disk type="block" device="disk">
Aug 17 17:27:13 user nova-compute[72724]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:27:13 user nova-compute[72724]:       <source dev="/dev/sdc"/>
Aug 17 17:27:13 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:27:13 user nova-compute[72724]:       <serial>6556f2e8-0a56-4a65-b5c7-5fda875f301d</serial>
Aug 17 17:27:13 user nova-compute[72724]:     </disk>
Aug 17 17:27:13 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:27:13 user nova-compute[72724]:       <mac address="fa:16:3e:6b:fa:6a"/>
Aug 17 17:27:13 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:27:13 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:27:13 user nova-compute[72724]:       <target dev="tapc43669d2-c1"/>
Aug 17 17:27:13 user nova-compute[72724]:     </interface>
Aug 17 17:27:13 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:27:13 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/b167a400-9be9-4980-9503-275b311f4794/console.log" append="off"/>
Aug 17 17:27:13 user nova-compute[72724]:     </serial>
Aug 17 17:27:13 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:27:13 user nova-compute[72724]:     <video>
Aug 17 17:27:13 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:27:13 user nova-compute[72724]:     </video>
Aug 17 17:27:13 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:27:13 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:27:13 user nova-compute[72724]:     </rng>
Aug 17 17:27:13 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:27:13 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:27:13 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:27:13 user nova-compute[72724]:     </memballoon>
Aug 17 17:27:13 user nova-compute[72724]:   </devices>
Aug 17 17:27:13 user nova-compute[72724]: </domain>
Aug 17 17:27:13 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-4292723',display_name='tempest-TestVolumeBootPattern-server-4292723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-4292723',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-gttdmws9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:27:01Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=b167a400-9be9-4980-9503-275b311f4794,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG os_vif [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc43669d2-c1, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc43669d2-c1, col_values=(('external_ids', {'iface-id': 'c43669d2-c1ed-4fe4-8000-524e47b8adfd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:fa:6a', 'vm-uuid': 'b167a400-9be9-4980-9503-275b311f4794'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:13 user nova-compute[72724]: INFO os_vif [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1')
Aug 17 17:27:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:27:13 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] No VIF found with MAC fa:16:3e:6b:fa:6a, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-648e4fa9-8c60-4a11-a1a0-fb5b008f80e4 req-70cff879-f499-4656-a0f1-a03bffc1e5d6 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-648e4fa9-8c60-4a11-a1a0-fb5b008f80e4 req-70cff879-f499-4656-a0f1-a03bffc1e5d6 service nova] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-648e4fa9-8c60-4a11-a1a0-fb5b008f80e4 req-70cff879-f499-4656-a0f1-a03bffc1e5d6 service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-648e4fa9-8c60-4a11-a1a0-fb5b008f80e4 req-70cff879-f499-4656-a0f1-a03bffc1e5d6 service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG nova.compute.manager [req-648e4fa9-8c60-4a11-a1a0-fb5b008f80e4 req-70cff879-f499-4656-a0f1-a03bffc1e5d6 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] No waiting events found dispatching network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:27:14 user nova-compute[72724]: WARNING nova.compute.manager [req-648e4fa9-8c60-4a11-a1a0-fb5b008f80e4 req-70cff879-f499-4656-a0f1-a03bffc1e5d6 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received unexpected event network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd for instance with vm_state building and task_state spawning.
Aug 17 17:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-dbf2ee39-66be-417f-a133-a84160f2bb89 req-b1c235c6-fe08-437f-bd1f-1f2e79ac69d7 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dbf2ee39-66be-417f-a133-a84160f2bb89 req-b1c235c6-fe08-437f-bd1f-1f2e79ac69d7 service nova] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dbf2ee39-66be-417f-a133-a84160f2bb89 req-b1c235c6-fe08-437f-bd1f-1f2e79ac69d7 service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-dbf2ee39-66be-417f-a133-a84160f2bb89 req-b1c235c6-fe08-437f-bd1f-1f2e79ac69d7 service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [req-dbf2ee39-66be-417f-a133-a84160f2bb89 req-b1c235c6-fe08-437f-bd1f-1f2e79ac69d7 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] No waiting events found dispatching network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:27:16 user nova-compute[72724]: WARNING nova.compute.manager [req-dbf2ee39-66be-417f-a133-a84160f2bb89 req-b1c235c6-fe08-437f-bd1f-1f2e79ac69d7 service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received unexpected event network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd for instance with vm_state building and task_state spawning.
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692293236.6086957, b167a400-9be9-4980-9503-275b311f4794 => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] VM Resumed (Lifecycle Event)
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b167a400-9be9-4980-9503-275b311f4794] Instance spawned successfully.
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692293236.6095653, b167a400-9be9-4980-9503-275b311f4794 => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] VM Started (Lifecycle Event)
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Took 5.12 seconds to spawn the instance on the hypervisor.
Aug 17 17:27:16 user nova-compute[72724]: DEBUG nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: b167a400-9be9-4980-9503-275b311f4794] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:27:16 user nova-compute[72724]: INFO nova.compute.manager [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Took 16.12 seconds to build instance.
Aug 17 17:27:16 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-02838431-90b0-4336-8204-42fc0ed84ea0 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "b167a400-9be9-4980-9503-275b311f4794" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.215s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:27:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:27:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:27:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8683MB free_disk=25.341079711914062GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b167a400-9be9-4980-9503-275b311f4794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:27:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:27:26 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:28 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:27:29 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:27:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:27:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:27:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:27:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:27:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:27:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:27:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:27:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:27:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:27:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:28:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:28:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:28:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:28:24 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:28:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:28:25 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8760MB free_disk=25.34042739868164GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance b167a400-9be9-4980-9503-275b311f4794 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:28:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:28:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:28:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:28:30 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating instance_info_cache with network_info: [{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:28:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:28:40 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:28:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-changed-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Refreshing instance network info cache due to event network-changed-c43669d2-c1ed-4fe4-8000-524e47b8adfd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] Acquiring lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] Acquired lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Refreshing network info cache for port c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Updated VIF entry in instance network info cache for port c43669d2-c1ed-4fe4-8000-524e47b8adfd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating instance_info_cache with network_info: [{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-01f218ed-0809-4a40-84a3-eaf54695983b req-ca5f4978-8152-45b3-89c0-b3928c4518ea service nova] Releasing lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-changed-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.compute.manager [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Refreshing instance network info cache due to event network-changed-c43669d2-c1ed-4fe4-8000-524e47b8adfd. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] Acquiring lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] Acquired lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:28:53 user nova-compute[72724]: DEBUG nova.network.neutron [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Refreshing network info cache for port c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "b167a400-9be9-4980-9503-275b311f4794" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "b167a400-9be9-4980-9503-275b311f4794-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "b167a400-9be9-4980-9503-275b311f4794-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:54 user nova-compute[72724]: INFO nova.compute.manager [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Terminating instance
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-cab5f066-ba62-4d08-84e7-1fb89950b3ab req-7235faf8-cdcf-48a0-b93f-b67a3f3bbc9e service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-vif-unplugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cab5f066-ba62-4d08-84e7-1fb89950b3ab req-7235faf8-cdcf-48a0-b93f-b67a3f3bbc9e service nova] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cab5f066-ba62-4d08-84e7-1fb89950b3ab req-7235faf8-cdcf-48a0-b93f-b67a3f3bbc9e service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-cab5f066-ba62-4d08-84e7-1fb89950b3ab req-7235faf8-cdcf-48a0-b93f-b67a3f3bbc9e service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-cab5f066-ba62-4d08-84e7-1fb89950b3ab req-7235faf8-cdcf-48a0-b93f-b67a3f3bbc9e service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] No waiting events found dispatching network-vif-unplugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-cab5f066-ba62-4d08-84e7-1fb89950b3ab req-7235faf8-cdcf-48a0-b93f-b67a3f3bbc9e service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-vif-unplugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Updated VIF entry in instance network info cache for port c43669d2-c1ed-4fe4-8000-524e47b8adfd. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.network.neutron [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating instance_info_cache with network_info: [{"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-7f155950-cd3d-4beb-a8a5-309714e89027 req-cfb5c1d9-bb41-4637-bccf-b62fd6ba5f5d service nova] Releasing lock "refresh_cache-b167a400-9be9-4980-9503-275b311f4794" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:28:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: b167a400-9be9-4980-9503-275b311f4794] Instance destroyed successfully.
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'resources' on Instance uuid b167a400-9be9-4980-9503-275b311f4794 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-4292723',display_name='tempest-TestVolumeBootPattern-server-4292723',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-4292723',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:27:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-gttdmws9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:27:17Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=b167a400-9be9-4980-9503-275b311f4794,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "address": "fa:16:3e:6b:fa:6a", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.16", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc43669d2-c1", "ovs_interfaceid": "c43669d2-c1ed-4fe4-8000-524e47b8adfd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_vif [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc43669d2-c1, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:28:54 user nova-compute[72724]: INFO os_vif [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:fa:6a,bridge_name='br-int',has_traffic_filtering=True,id=c43669d2-c1ed-4fe4-8000-524e47b8adfd,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc43669d2-c1')
Aug 17 17:28:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dZAiahTk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:28:54 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed17013b-10f4-400f-b7fd-266acb003485]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75049e5-f460-4e5c-8b63-85a05ff1a511]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:28:54 user nova-compute[72724]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d (non-flash)
Aug 17 17:28:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:28:54 user nova-compute[72724]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d (non-flash)
Aug 17 17:28:54 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e83afc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d'): ({'sdc'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Removing single pathed devices sdc {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa35133-edbe-4f05-8757-5f8e0a75d8ef]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2af7b5-3223-49dd-9c26-0b7f17e6f209]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flushing IO for device /dev/sdc {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a537f3ab-29f9-4cf0-832e-8ca0f07760fd]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:28:54 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f760cfd-b20f-4b3f-9d70-fd1414714abe]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] SCSI volumes sdc have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[908c765e-78e7-48f9-8db9-109750a1ae35]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[467ed618-65a5-4deb-a0d7-2965b6780b54]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260]
Aug 17 17:28:55 user nova-compute[72724]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d, portal: 172.16.0.220,3260] successful.
Aug 17 17:28:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6556f2e8-0a56-4a65-b5c7-5fda875f301d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b8c1cf-dfd9-4f20-a1d5-ed63b3c66579]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== disconnect_volume: return (286ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:28:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Deleting instance files /opt/stack/data/nova/instances/b167a400-9be9-4980-9503-275b311f4794_del
Aug 17 17:28:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Deletion of /opt/stack/data/nova/instances/b167a400-9be9-4980-9503-275b311f4794_del complete
Aug 17 17:28:55 user nova-compute[72724]: INFO nova.compute.manager [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 17 17:28:55 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: b167a400-9be9-4980-9503-275b311f4794] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: b167a400-9be9-4980-9503-275b311f4794] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:28:55 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: b167a400-9be9-4980-9503-275b311f4794] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:28:55 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: b167a400-9be9-4980-9503-275b311f4794] Took 0.55 seconds to deallocate network for instance.
Aug 17 17:28:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] Acquiring lock "b167a400-9be9-4980-9503-275b311f4794-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] Lock "b167a400-9be9-4980-9503-275b311f4794-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] No waiting events found dispatching network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:28:56 user nova-compute[72724]: WARNING nova.compute.manager [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received unexpected event network-vif-plugged-c43669d2-c1ed-4fe4-8000-524e47b8adfd for instance with vm_state active and task_state deleting.
Aug 17 17:28:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-ce8a54bb-7a12-47e8-acc0-a7c3ea616b1a req-9c55611f-da52-4ddf-a33c-329818a208eb service nova] [instance: b167a400-9be9-4980-9503-275b311f4794] Received event network-vif-deleted-c43669d2-c1ed-4fe4-8000-524e47b8adfd {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:28:56 user nova-compute[72724]: INFO nova.compute.manager [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: b167a400-9be9-4980-9503-275b311f4794] Took 0.76 seconds to detach 1 volumes for instance.
Aug 17 17:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:28:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.362s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:57 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Deleted allocations for instance b167a400-9be9-4980-9503-275b311f4794
Aug 17 17:28:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e0b9e18b-f30c-4fee-b346-3eecca167149 tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "b167a400-9be9-4980-9503-275b311f4794" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.083s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:28:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:28:59 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:29:04 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:06 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:29:06 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:29:09 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692293334.8357344, b167a400-9be9-4980-9503-275b311f4794 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:29:09 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: b167a400-9be9-4980-9503-275b311f4794] VM Stopped (Lifecycle Event)
Aug 17 17:29:09 user nova-compute[72724]: DEBUG nova.compute.manager [None req-d2cca8e7-516a-4872-bbd3-71528fe18364 None None] [instance: b167a400-9be9-4980-9503-275b311f4794] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:29:09 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:14 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:19 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:29:25 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:29:26 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:29:26 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=25.339553833007812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:29:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.290s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:29:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:29 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:29:31 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:29:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:29:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:44 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-changed-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG nova.compute.manager [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Refreshing instance network info cache due to event network-changed-edcaddbe-ca1d-4dce-9761-8d3e86cb7720. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] Acquiring lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] Acquired lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG nova.network.neutron [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Refreshing network info cache for port edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:29:57 user nova-compute[72724]: INFO nova.compute.manager [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Terminating instance
Aug 17 17:29:57 user nova-compute[72724]: DEBUG nova.compute.manager [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.network.neutron [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updated VIF entry in instance network info cache for port edcaddbe-ca1d-4dce-9761-8d3e86cb7720. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.network.neutron [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [{"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-fde3f516-cc80-469f-9850-88ae3455b5c7 req-c65b29fb-0a64-4fa4-96bf-7b2c87b3f5e7 service nova] Releasing lock "refresh_cache-13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:29:58 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Instance destroyed successfully.
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.objects.instance [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lazy-loading 'resources' on Instance uuid 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:24:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1103205548',display_name='tempest-TestVolumeBootPattern-server-1103205548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1103205548',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCbk/El8ZNg1C99+WcmnWUEXB71jOCqAG9bhJxYx6JIEhJiZ9Dv1X5ABGWBX0Tmd8WuQwAq9Xx+/5yOaLxl+RUKoHmmd6UEJ7p90+HGMMkcu+CVbqga5MxareHl4XKUXuw==',key_name='tempest-TestVolumeBootPattern-2128743932',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:25:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0c38413cbee44af48869f91b661b1333',ramdisk_id='',reservation_id='r-vmno7c6h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-924115856',owner_user_name='tempest-TestVolumeBootPattern-924115856-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:25:17Z,user_data=None,user_id='e503ef7b08034c8ea4135912c91d9c0f',uuid=13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converting VIF {"id": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "address": "fa:16:3e:3c:0a:f4", "network": {"id": "e8625659-e0f5-44d7-9e57-618207767dc0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-873931409-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0c38413cbee44af48869f91b661b1333", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedcaddbe-ca", "ovs_interfaceid": "edcaddbe-ca1d-4dce-9761-8d3e86cb7720", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_vif [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedcaddbe-ca, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:29:58 user nova-compute[72724]: INFO os_vif [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:0a:f4,bridge_name='br-int',has_traffic_filtering=True,id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720,network=Network(e8625659-e0f5-44d7-9e57-618207767dc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedcaddbe-ca')
Aug 17 17:29:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RzNtXGhc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:29:58 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b498a77a-c2b2-41c4-817f-092e8d3bb842]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c17f54-aded-4780-8035-d195bbb332ba]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:29:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de (non-flash)
Aug 17 17:29:58 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c834fbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b46e82-b2c1-4e9b-a2c3-cd9fdddf5d4a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cbf02a-474d-474b-9da2-08134e259819]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[93caa06f-9f4a-46c2-8bd8-db31c310f16c]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:29:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e707fbd-3718-40b8-9891-5f68764b2211]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[106c0a6b-69cd-4ea1-9f07-7e4d6af28f48]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae471734-fd87-40c4-b919-d7053b89bb10]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260]
Aug 17 17:29:59 user nova-compute[72724]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de, portal: 172.16.0.220,3260] successful.
Aug 17 17:29:59 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a010a161-393d-4976-a9a9-92773c77d0de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[be80633a-4e52-4358-b50a-eee46aaa1ae9]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] <== disconnect_volume: return (282ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:29:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Deleting instance files /opt/stack/data/nova/instances/13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6_del
Aug 17 17:29:59 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Deletion of /opt/stack/data/nova/instances/13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6_del complete
Aug 17 17:29:59 user nova-compute[72724]: INFO nova.compute.manager [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Took 1.33 seconds to destroy the instance on the hypervisor.
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:29:59 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Took 0.53 seconds to deallocate network for instance.
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-36db7b67-85e8-4b2b-9cc9-d3c5db3da1a3 req-a8888a0c-4e5a-4392-b641-de3a5afb7965 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-vif-deleted-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:29:59 user nova-compute[72724]: INFO nova.compute.manager [req-36db7b67-85e8-4b2b-9cc9-d3c5db3da1a3 req-a8888a0c-4e5a-4392-b641-de3a5afb7965 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Neutron deleted interface edcaddbe-ca1d-4dce-9761-8d3e86cb7720; detaching it from the instance and deleting it from the info cache
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.network.neutron [req-36db7b67-85e8-4b2b-9cc9-d3c5db3da1a3 req-a8888a0c-4e5a-4392-b641-de3a5afb7965 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-36db7b67-85e8-4b2b-9cc9-d3c5db3da1a3 req-a8888a0c-4e5a-4392-b641-de3a5afb7965 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Detach interface failed, port_id=edcaddbe-ca1d-4dce-9761-8d3e86cb7720, reason: Instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 could not be found. {{(pid=72724) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-vif-unplugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] No waiting events found dispatching network-vif-unplugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-vif-unplugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received event network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] Acquiring lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:29:59 user nova-compute[72724]: DEBUG nova.compute.manager [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] No waiting events found dispatching network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:29:59 user nova-compute[72724]: WARNING nova.compute.manager [req-ee0c9530-5ff3-4207-922b-6f08f7d16f29 req-450e9379-ff64-4b9f-a7ca-e976bc2026f2 service nova] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Received unexpected event network-vif-plugged-edcaddbe-ca1d-4dce-9761-8d3e86cb7720 for instance with vm_state active and task_state deleting.
Aug 17 17:30:00 user nova-compute[72724]: INFO nova.compute.manager [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Took 0.83 seconds to detach 1 volumes for instance.
Aug 17 17:30:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:30:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:30:00 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:30:00 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:30:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.111s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:30:00 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Deleted allocations for instance 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6
Aug 17 17:30:00 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-8b57519e-4e46-4b32-840b-7155334eacee tempest-TestVolumeBootPattern-924115856 tempest-TestVolumeBootPattern-924115856-project-member] Lock "13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.991s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:30:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692293398.7763412, 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6 => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:30:13 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] VM Stopped (Lifecycle Event)
Aug 17 17:30:13 user nova-compute[72724]: DEBUG nova.compute.manager [None req-e547a2c3-aac0-4689-9e92-c09b907d473c None None] [instance: 13cf29ab-0fac-4f93-8e1d-6762bd3f5fc6] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:30:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:25 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:30:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:30:25 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:30:25 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:30:26 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:30:26 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:30:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.338665008544922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:30:26 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:30:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:30:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:30:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:30:31 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:30:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:30:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:30:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:30:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:30:58 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:03 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:08 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:31:13 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:31:18 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:23 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:27 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:27 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:31:28 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:31:28 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:31:28 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8687MB free_disk=25.32758331298828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:31:32 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:31:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:31:33 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:34 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:31:38 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:39 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:43 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Starting instance... {{(pid=72724) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72724) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 17 17:31:48 user nova-compute[72724]: INFO nova.compute.claims [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Claim successful on node user
Aug 17 17:31:48 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.268s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:48 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Start building networks asynchronously for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Allocating IP information in the background. {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.network.neutron [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] allocate_for_instance() {{(pid=72724) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 17 17:31:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Start building block device mappings for instance. {{(pid=72724) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Start spawning the instance on the hypervisor. {{(pid=72724) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Creating instance directory {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 17 17:31:49 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Creating image(s)
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "/opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "/opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.policy [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddb7b05e32b741188c4c7f8947f41af4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b62c19ab817422b833051fd91eb229a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72724) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.201s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "b03bde4555170889934ac3c361a174084018845b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk 1073741824 {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b,backing_fmt=raw /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk 1073741824" returned: 0 in 0.063s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "b03bde4555170889934ac3c361a174084018845b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk. size=1073741824 {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 17 17:31:49 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG nova.virt.disk.api [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Cannot resize image /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk to a smaller size. {{(pid=72724) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG nova.objects.instance [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'migration_context' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Created local disks {{(pid=72724) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Ensure instance console log exists: /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/console.log {{(pid=72724) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:50 user nova-compute[72724]: DEBUG nova.network.neutron [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Successfully created port: be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG nova.network.neutron [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Successfully updated port: be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG nova.network.neutron [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Building network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-changed-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG nova.compute.manager [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Refreshing instance network info cache due to event network-changed-be57214d-a630-4ede-b697-694134e33a12. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:31:51 user nova-compute[72724]: DEBUG nova.network.neutron [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Instance cache missing network info. {{(pid=72724) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.neutron [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Instance network_info: |[{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72724) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Refreshing network info cache for port be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Start _get_guest_xml network_info=[{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_format': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'guest_format': None, 'size': 0, 'boot_index': 0, 'encryption_options': None, 'encryption_secret_uuid': None, 'image_id': '7987af0c-3aeb-4281-9a1e-f00b1aa170d2'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 17 17:31:52 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:31:52 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CPU controller missing on host. {{(pid=72724) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.host [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CPU controller found on host. {{(pid=72724) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72724) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-17T16:17:39Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-17T16:17:50Z,direct_url=<?>,disk_format='qcow2',id=7987af0c-3aeb-4281-9a1e-f00b1aa170d2,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='60a6cd0c01de4c6ea99688dc807b89a5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-17T16:17:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Flavor limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Image limits 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Flavor pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Image pref 0:0:0 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72724) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Got 1 possible topologies {{(pid=72724) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.hardware [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72724) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-62967998',display_name='tempest-SnapshotDataIntegrityTests-server-62967998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-62967998',id=53,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUuay5xOWMlq/cj81bnHy7jWjVxSvVvchMzezvmOrS/4FgqEtSYXUP8ut+d0C+1xVtos1ofNQshrHb4yIiWDKfqvW9u8jZM2QkT6GGyKuEj1K5pd2E5ncY2bRzz5wETJw==',key_name='tempest-keypair-1406052084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b62c19ab817422b833051fd91eb229a',ramdisk_id='',reservation_id='r-c349z8py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1572416586',owner_user_name='tempest-SnapshotDataIntegrityTests-1572416586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb7b05e32b741188c4c7f8947f41af4',uuid=cc76070a-b519-41e3-a023-19bfa5dfac5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72724) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Converting VIF {"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.objects.instance [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'pci_devices' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] End _get_guest_xml xml=<domain type="kvm">
Aug 17 17:31:52 user nova-compute[72724]:   <uuid>cc76070a-b519-41e3-a023-19bfa5dfac5e</uuid>
Aug 17 17:31:52 user nova-compute[72724]:   <name>instance-00000035</name>
Aug 17 17:31:52 user nova-compute[72724]:   <memory>524288</memory>
Aug 17 17:31:52 user nova-compute[72724]:   <vcpu>1</vcpu>
Aug 17 17:31:52 user nova-compute[72724]:   <metadata>
Aug 17 17:31:52 user nova-compute[72724]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 17 17:31:52 user nova-compute[72724]:       <nova:package version="0.0.0"/>
Aug 17 17:31:52 user nova-compute[72724]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-62967998</nova:name>
Aug 17 17:31:52 user nova-compute[72724]:       <nova:creationTime>2023-08-17 17:31:52</nova:creationTime>
Aug 17 17:31:52 user nova-compute[72724]:       <nova:flavor name="m1.tiny">
Aug 17 17:31:52 user nova-compute[72724]:         <nova:memory>512</nova:memory>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:disk>1</nova:disk>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:swap>0</nova:swap>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:ephemeral>0</nova:ephemeral>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:vcpus>1</nova:vcpus>
Aug 17 17:31:52 user nova-compute[72724]:       </nova:flavor>
Aug 17 17:31:52 user nova-compute[72724]:       <nova:owner>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:user uuid="ddb7b05e32b741188c4c7f8947f41af4">tempest-SnapshotDataIntegrityTests-1572416586-project-member</nova:user>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:project uuid="0b62c19ab817422b833051fd91eb229a">tempest-SnapshotDataIntegrityTests-1572416586</nova:project>
Aug 17 17:31:52 user nova-compute[72724]:       </nova:owner>
Aug 17 17:31:52 user nova-compute[72724]:       <nova:root type="image" uuid="7987af0c-3aeb-4281-9a1e-f00b1aa170d2"/>
Aug 17 17:31:52 user nova-compute[72724]:       <nova:ports>
Aug 17 17:31:52 user nova-compute[72724]:         <nova:port uuid="be57214d-a630-4ede-b697-694134e33a12">
Aug 17 17:31:52 user nova-compute[72724]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 17 17:31:52 user nova-compute[72724]:         </nova:port>
Aug 17 17:31:52 user nova-compute[72724]:       </nova:ports>
Aug 17 17:31:52 user nova-compute[72724]:     </nova:instance>
Aug 17 17:31:52 user nova-compute[72724]:   </metadata>
Aug 17 17:31:52 user nova-compute[72724]:   <sysinfo type="smbios">
Aug 17 17:31:52 user nova-compute[72724]:     <system>
Aug 17 17:31:52 user nova-compute[72724]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 17 17:31:52 user nova-compute[72724]:       <entry name="product">OpenStack Nova</entry>
Aug 17 17:31:52 user nova-compute[72724]:       <entry name="version">0.0.0</entry>
Aug 17 17:31:52 user nova-compute[72724]:       <entry name="serial">cc76070a-b519-41e3-a023-19bfa5dfac5e</entry>
Aug 17 17:31:52 user nova-compute[72724]:       <entry name="uuid">cc76070a-b519-41e3-a023-19bfa5dfac5e</entry>
Aug 17 17:31:52 user nova-compute[72724]:       <entry name="family">Virtual Machine</entry>
Aug 17 17:31:52 user nova-compute[72724]:     </system>
Aug 17 17:31:52 user nova-compute[72724]:   </sysinfo>
Aug 17 17:31:52 user nova-compute[72724]:   <os>
Aug 17 17:31:52 user nova-compute[72724]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 17 17:31:52 user nova-compute[72724]:     <boot dev="hd"/>
Aug 17 17:31:52 user nova-compute[72724]:     <smbios mode="sysinfo"/>
Aug 17 17:31:52 user nova-compute[72724]:   </os>
Aug 17 17:31:52 user nova-compute[72724]:   <features>
Aug 17 17:31:52 user nova-compute[72724]:     <acpi/>
Aug 17 17:31:52 user nova-compute[72724]:     <apic/>
Aug 17 17:31:52 user nova-compute[72724]:     <vmcoreinfo/>
Aug 17 17:31:52 user nova-compute[72724]:   </features>
Aug 17 17:31:52 user nova-compute[72724]:   <clock offset="utc">
Aug 17 17:31:52 user nova-compute[72724]:     <timer name="pit" tickpolicy="delay"/>
Aug 17 17:31:52 user nova-compute[72724]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 17 17:31:52 user nova-compute[72724]:     <timer name="hpet" present="no"/>
Aug 17 17:31:52 user nova-compute[72724]:   </clock>
Aug 17 17:31:52 user nova-compute[72724]:   <cpu mode="custom" match="exact">
Aug 17 17:31:52 user nova-compute[72724]:     <model>Nehalem</model>
Aug 17 17:31:52 user nova-compute[72724]:     <topology sockets="1" cores="1" threads="1"/>
Aug 17 17:31:52 user nova-compute[72724]:   </cpu>
Aug 17 17:31:52 user nova-compute[72724]:   <devices>
Aug 17 17:31:52 user nova-compute[72724]:     <disk type="file" device="disk">
Aug 17 17:31:52 user nova-compute[72724]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 17 17:31:52 user nova-compute[72724]:       <source file="/opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk"/>
Aug 17 17:31:52 user nova-compute[72724]:       <target dev="vda" bus="virtio"/>
Aug 17 17:31:52 user nova-compute[72724]:     </disk>
Aug 17 17:31:52 user nova-compute[72724]:     <interface type="ethernet">
Aug 17 17:31:52 user nova-compute[72724]:       <mac address="fa:16:3e:e9:ac:e4"/>
Aug 17 17:31:52 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:31:52 user nova-compute[72724]:       <mtu size="1442"/>
Aug 17 17:31:52 user nova-compute[72724]:       <target dev="tapbe57214d-a6"/>
Aug 17 17:31:52 user nova-compute[72724]:     </interface>
Aug 17 17:31:52 user nova-compute[72724]:     <serial type="pty">
Aug 17 17:31:52 user nova-compute[72724]:       <log file="/opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/console.log" append="off"/>
Aug 17 17:31:52 user nova-compute[72724]:     </serial>
Aug 17 17:31:52 user nova-compute[72724]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 17 17:31:52 user nova-compute[72724]:     <video>
Aug 17 17:31:52 user nova-compute[72724]:       <model type="virtio"/>
Aug 17 17:31:52 user nova-compute[72724]:     </video>
Aug 17 17:31:52 user nova-compute[72724]:     <rng model="virtio">
Aug 17 17:31:52 user nova-compute[72724]:       <backend model="random">/dev/urandom</backend>
Aug 17 17:31:52 user nova-compute[72724]:     </rng>
Aug 17 17:31:52 user nova-compute[72724]:     <controller type="usb" index="0" model="none"/>
Aug 17 17:31:52 user nova-compute[72724]:     <memballoon model="virtio">
Aug 17 17:31:52 user nova-compute[72724]:       <stats period="10"/>
Aug 17 17:31:52 user nova-compute[72724]:     </memballoon>
Aug 17 17:31:52 user nova-compute[72724]:   </devices>
Aug 17 17:31:52 user nova-compute[72724]: </domain>
Aug 17 17:31:52 user nova-compute[72724]:  {{(pid=72724) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-62967998',display_name='tempest-SnapshotDataIntegrityTests-server-62967998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-62967998',id=53,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUuay5xOWMlq/cj81bnHy7jWjVxSvVvchMzezvmOrS/4FgqEtSYXUP8ut+d0C+1xVtos1ofNQshrHb4yIiWDKfqvW9u8jZM2QkT6GGyKuEj1K5pd2E5ncY2bRzz5wETJw==',key_name='tempest-keypair-1406052084',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b62c19ab817422b833051fd91eb229a',ramdisk_id='',reservation_id='r-c349z8py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1572416586',owner_user_name='tempest-SnapshotDataIntegrityTests-1572416586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-17T17:31:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb7b05e32b741188c4c7f8947f41af4',uuid=cc76070a-b519-41e3-a023-19bfa5dfac5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Converting VIF {"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG os_vif [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6') {{(pid=72724) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbe57214d-a6, may_exist=True, interface_attrs={}) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbe57214d-a6, col_values=(('external_ids', {'iface-id': 'be57214d-a630-4ede-b697-694134e33a12', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:ac:e4', 'vm-uuid': 'cc76070a-b519-41e3-a023-19bfa5dfac5e'}),), if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:52 user nova-compute[72724]: INFO os_vif [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6')
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No VIF found with MAC fa:16:3e:e9:ac:e4, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated VIF entry in instance network info cache for port be57214d-a630-4ede-b697-694134e33a12. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG nova.network.neutron [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:31:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-96fed100-5a08-4e1c-9739-808d97262186 req-e2c8e58d-2144-4891-80aa-de1a6ed9426f service nova] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:31:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:53 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-300a54c6-1dc1-4bd7-acf7-d120d0cd6f54 req-014a41ed-5eec-4a56-919c-ef9dd249d6b6 service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-300a54c6-1dc1-4bd7-acf7-d120d0cd6f54 req-014a41ed-5eec-4a56-919c-ef9dd249d6b6 service nova] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-300a54c6-1dc1-4bd7-acf7-d120d0cd6f54 req-014a41ed-5eec-4a56-919c-ef9dd249d6b6 service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-300a54c6-1dc1-4bd7-acf7-d120d0cd6f54 req-014a41ed-5eec-4a56-919c-ef9dd249d6b6 service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG nova.compute.manager [req-300a54c6-1dc1-4bd7-acf7-d120d0cd6f54 req-014a41ed-5eec-4a56-919c-ef9dd249d6b6 service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] No waiting events found dispatching network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:31:54 user nova-compute[72724]: WARNING nova.compute.manager [req-300a54c6-1dc1-4bd7-acf7-d120d0cd6f54 req-014a41ed-5eec-4a56-919c-ef9dd249d6b6 service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received unexpected event network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 for instance with vm_state building and task_state spawning.
Aug 17 17:31:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:54 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692293516.246, cc76070a-b519-41e3-a023-19bfa5dfac5e => Resumed> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] VM Resumed (Lifecycle Event)
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Instance event wait completed in 0 seconds for  {{(pid=72724) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Guest created on hypervisor {{(pid=72724) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Instance spawned successfully.
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Found default for hw_cdrom_bus of ide {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Found default for hw_disk_bus of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Found default for hw_input_bus of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Found default for hw_pointer_model of None {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Found default for hw_video_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Found default for hw_vif_model of virtio {{(pid=72724) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-4497426d-79a5-44fd-b71f-c1b6a94fb6e7 req-ab5148e1-85d0-4f8f-8d50-24b6aebfff4e service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4497426d-79a5-44fd-b71f-c1b6a94fb6e7 req-ab5148e1-85d0-4f8f-8d50-24b6aebfff4e service nova] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4497426d-79a5-44fd-b71f-c1b6a94fb6e7 req-ab5148e1-85d0-4f8f-8d50-24b6aebfff4e service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-4497426d-79a5-44fd-b71f-c1b6a94fb6e7 req-ab5148e1-85d0-4f8f-8d50-24b6aebfff4e service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [req-4497426d-79a5-44fd-b71f-c1b6a94fb6e7 req-ab5148e1-85d0-4f8f-8d50-24b6aebfff4e service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] No waiting events found dispatching network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:31:56 user nova-compute[72724]: WARNING nova.compute.manager [req-4497426d-79a5-44fd-b71f-c1b6a94fb6e7 req-ab5148e1-85d0-4f8f-8d50-24b6aebfff4e service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received unexpected event network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 for instance with vm_state building and task_state spawning.
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.virt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Emitting event <LifecycleEvent: 1692293516.2509933, cc76070a-b519-41e3-a023-19bfa5dfac5e => Started> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] VM Started (Lifecycle Event)
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72724) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.compute.manager [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Took 7.20 seconds to spawn the instance on the hypervisor.
Aug 17 17:31:56 user nova-compute[72724]: DEBUG nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:31:56 user nova-compute[72724]: INFO nova.compute.manager [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Took 7.89 seconds to build instance.
Aug 17 17:31:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-19e262a8-ea13-4764-a029-b396a705da55 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.027s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:31:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:31:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:32:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:32:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:32:30 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:32:30 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8555MB free_disk=25.293197631835938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:32:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:32:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:32:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:32:33 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:32:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:32:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:32:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:32:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:32:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:32:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:32:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:32:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:32:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:32:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:32:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:32:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:32:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:32:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:33:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:29 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:30 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:33:30 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=25.283138275146484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:33:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:33:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:33:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:33 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:33:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:33:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:33:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:33:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:33:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:33:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:33:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:33:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:33:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-changed-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG nova.compute.manager [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Refreshing instance network info cache due to event network-changed-be57214d-a630-4ede-b697-694134e33a12. {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG nova.network.neutron [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Refreshing network info cache for port be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG nova.network.neutron [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated VIF entry in instance network info cache for port be57214d-a630-4ede-b697-694134e33a12. {{(pid=72724) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG nova.network.neutron [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:33:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-b7f739ba-9ee9-49d6-a718-7cece07bad1f req-e89a92ca-f169-471a-a572-300f201ac11c service nova] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:33:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:44 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:44 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG nova.objects.instance [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:33:45 user nova-compute[72724]: INFO nova.compute.manager [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attaching volume 567906ab-d2e6-4aec-b958-3bbbb6be80cd to /dev/vdb
Aug 17 17:33:45 user nova-compute[72724]: DEBUG os_brick.utils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[98352025-3715-4f63-bb41-d7557e11a4ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed63d97-4eaa-430a-81ce-cef700f49d1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec6464e-236d-4d4a-886b-c299d174570a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64a7875-e31a-4dad-a464-fea914fab45b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:33:45 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:33:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c5e6ad-3cd3-47df-86ff-e700ea478e69]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG os_brick.utils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:33:45 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating existing volume attachment record: be9d95f4-c820-49ba-881d-17df1a6d9ed9 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:33:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:33:49 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIzAOqgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:33:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:33:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:33:56 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a366196-4f0f-450b-9416-af21edafa885]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:33:56 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61f8526-45ad-4487-b76e-388e99bde900]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd] added
Aug 17 17:33:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[34de7a27-a19f-487c-9610-031ac276fbae]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e970d412-8754-4c6a-8827-028fbc62b667]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIzAOqgR {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uIzAOqgR" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9180d8cc-c2df-40fa-bcba-ff23523d72f6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uIzAOqgR'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df7a44e-57c7-40bd-8aab-c04358f868ec]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a10d2cbb-1830-4bbf-9e5b-0b013ac1750e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:33:56 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:33:56 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:33:56 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:33:56 user nova-compute[72724]: 
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[862bafe4-0e83-4887-a98e-ddf841d293da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260]
Aug 17 17:33:56 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260] successful.
Aug 17 17:33:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7730e699-3c6e-4b11-aaed-12dfa340d0af]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b6c55c-6b0e-4660-a3f0-59f902988bff]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd (non-flash)
Aug 17 17:33:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd (non-flash)
Aug 17 17:33:56 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7458670c-239c-4495-afcc-580a1f8e0646]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:33:56 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIzAOqgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '23031666134363163', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031666134363163', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG nova.objects.instance [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:33:57 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:33:57 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:33:57 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:33:57 user nova-compute[72724]:   <serial>567906ab-d2e6-4aec-b958-3bbbb6be80cd</serial>
Aug 17 17:33:57 user nova-compute[72724]: </disk>
Aug 17 17:33:57 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No VIF found with MAC fa:16:3e:e9:ac:e4, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:33:57 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-70e0f896-c519-47fc-9f92-763738acda09 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.229s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:34:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:10 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:34:10 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:34:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:34:27 user nova-compute[72724]: INFO nova.compute.manager [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Detaching volume 567906ab-d2e6-4aec-b958-3bbbb6be80cd
Aug 17 17:34:27 user nova-compute[72724]: INFO nova.virt.block_device [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attempting to driver detach volume 567906ab-d2e6-4aec-b958-3bbbb6be80cd from mountpoint /dev/vdb
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Attempting to detach device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:34:27 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:34:27 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:34:27 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:34:27 user nova-compute[72724]:   <serial>567906ab-d2e6-4aec-b958-3bbbb6be80cd</serial>
Aug 17 17:34:27 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:34:27 user nova-compute[72724]: </disk>
Aug 17 17:34:27 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:34:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config.
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:34:27 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:34:27 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:34:27 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:34:27 user nova-compute[72724]:   <serial>567906ab-d2e6-4aec-b958-3bbbb6be80cd</serial>
Aug 17 17:34:27 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:34:27 user nova-compute[72724]: </disk>
Aug 17 17:34:27 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692293667.7083988, cc76070a-b519-41e3-a023-19bfa5dfac5e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:34:27 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config.
Aug 17 17:34:27 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uIzAOqgR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:34:27 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4a09d4-5360-429f-8ce1-88430e87c3e3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[927066b2-8ff1-4b15-8ae9-07ac44a6dfa4]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd (non-flash)
Aug 17 17:34:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd (non-flash)
Aug 17 17:34:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e81192d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba06e88b-021e-4d7c-a0d1-a93af7460e7d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2363281b-4d68-481f-932d-96cf8278506c]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dfa819-f008-4e13-bede-3ab30c36adf1]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aea60b-513b-486e-958d-88e423ce3c1b]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[700dcbd4-ff73-41b9-9617-12f70b8b7836]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d636985-54c1-4b35-9277-62138c99dfd2]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260]
Aug 17 17:34:27 user nova-compute[72724]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd, portal: 172.16.0.220,3260] successful.
Aug 17 17:34:27 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:34:27 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:567906ab-d2e6-4aec-b958-3bbbb6be80cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be7de22-98bd-404d-ba4a-8c645f104816]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== disconnect_volume: return (299ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:34:28 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f1bb0cba-c1ad-44ba-8911-e5e044bde444 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.643s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:34:30 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:32 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:34:32 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8818MB free_disk=25.281448364257812GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:34:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:34:34 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:34:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:34:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:34:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:34:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:35:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:35:21 user nova-compute[72724]: INFO nova.compute.manager [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attaching volume b80a8e47-2153-4216-ae98-afa58a2d8845 to /dev/vdb
Aug 17 17:35:21 user nova-compute[72724]: DEBUG os_brick.utils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd3c0df-84dd-4c5f-b9dd-704b425a5264]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8154038c-2737-4083-81fb-2decf3966a7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5580de17-f7b7-470b-9962-24a0917a3ad9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[be355661-7fb9-4de9-b8fb-aeb2bc900271]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:35:21 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:35:21 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b9e940-715a-403b-8072-ee26358c4c8b]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG os_brick.utils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:35:21 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating existing volume attachment record: 8516e92c-372d-4c2f-983e-ca87fd70e5c7 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRKWbNfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:35:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:35:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:35:31 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cfef88-7a81-4de4-b842-5601b9089a96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:35:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9b255b-5d75-4e13-8a9c-3011d1c819c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845] added
Aug 17 17:35:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00f61b0-c0a4-4a1d-97aa-e09a0652ff61]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d18b8e-91f6-4e67-b1d7-dc393491832a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRKWbNfM {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HRKWbNfM" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6de8a1a-ddf3-4948-bc08-9213736e570e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HRKWbNfM'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[41771257-e19b-489a-ba68-9a7dcc67e3c6]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eceb9a0-e24f-44bd-b651-989dd4dd3bff]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:35:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:35:31 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:35:31 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:35:31 user nova-compute[72724]: 
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe7f9441-3a9b-430c-9d0b-8286ed2d99fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260]
Aug 17 17:35:31 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260] successful.
Aug 17 17:35:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0dbc563-9fe1-437b-85fa-a716aa3661fe]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[41dec701-f92f-4504-bea6-a3b783cd0306]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 (non-flash)
Aug 17 17:35:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 (non-flash)
Aug 17 17:35:31 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fbb4ce-6af4-4f98-ac4e-b715ecb00f3e]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:31 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRKWbNfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23235346237616634', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235346237616634', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:35:32 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:35:32 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:35:32 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:35:32 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:35:32 user nova-compute[72724]:   <serial>b80a8e47-2153-4216-ae98-afa58a2d8845</serial>
Aug 17 17:35:32 user nova-compute[72724]: </disk>
Aug 17 17:35:32 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No VIF found with MAC fa:16:3e:e9:ac:e4, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e97125fc-37b3-42a5-b431-7d58e9143cf9 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.873s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:33 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72724) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 17 17:35:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:35:34 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8838MB free_disk=25.280597686767578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:35:34 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:35:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:35:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:35:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:35:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:35:35 user nova-compute[72724]: INFO nova.compute.manager [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Detaching volume b80a8e47-2153-4216-ae98-afa58a2d8845
Aug 17 17:35:36 user nova-compute[72724]: INFO nova.virt.block_device [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attempting to driver detach volume b80a8e47-2153-4216-ae98-afa58a2d8845 from mountpoint /dev/vdb
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Attempting to detach device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:35:36 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:35:36 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:35:36 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:35:36 user nova-compute[72724]:   <serial>b80a8e47-2153-4216-ae98-afa58a2d8845</serial>
Aug 17 17:35:36 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:35:36 user nova-compute[72724]: </disk>
Aug 17 17:35:36 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:35:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config.
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:35:36 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:35:36 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:35:36 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:35:36 user nova-compute[72724]:   <serial>b80a8e47-2153-4216-ae98-afa58a2d8845</serial>
Aug 17 17:35:36 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:35:36 user nova-compute[72724]: </disk>
Aug 17 17:35:36 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692293736.4384658, cc76070a-b519-41e3-a023-19bfa5dfac5e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:35:36 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config.
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HRKWbNfM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:35:36 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacb6341-1072-4ac3-a0ec-b2ab6c1197a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a06a5a-da6a-445c-a0d6-b3cfca8a2a6c]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 (non-flash)
Aug 17 17:35:36 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 (non-flash)
Aug 17 17:35:36 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86e0248a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a14736f-5aad-47b1-929d-37403e31f45a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a2744b-0739-432d-93ce-e08092b19c7f]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70207f7-34e5-4b96-8dbf-23390a0a2112]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c179e6-8366-4aee-bf13-2f507381b250]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[804ad04a-8c3d-4148-af1f-e8f7989e571e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6a1eb1-d93f-4c7f-8f96-1ac9be614a75]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260]
Aug 17 17:35:36 user nova-compute[72724]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845, portal: 172.16.0.220,3260] successful.
Aug 17 17:35:36 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b80a8e47-2153-4216-ae98-afa58a2d8845 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c75c888-fd1e-45cd-8503-53c2bc9d1b34]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== disconnect_volume: return (260ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:35:36 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:35:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:37 user nova-compute[72724]: DEBUG nova.objects.instance [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:35:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-e50a58c7-6b0b-4475-b680-543cd7f98424 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:35:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:35:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:35:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:35:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:35:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:35:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:35:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:36:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:36:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG nova.objects.instance [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:36:30 user nova-compute[72724]: INFO nova.compute.manager [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attaching volume f22382e9-befc-4de7-b0da-1f6ab26103ed to /dev/vdb
Aug 17 17:36:30 user nova-compute[72724]: DEBUG os_brick.utils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68828ac-fa9e-49b2-b78e-4e18a55051cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6f3263-e33f-4bc4-be81-cdbfeb951a6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5410c3e7-63e2-423f-bb11-3d467b067a1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98d753f-7473-444c-903b-dfe5f81f2b70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:36:30 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:36:30 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f556a3-5f15-462a-b2f5-fe30750c62d4]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG os_brick.utils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:36:30 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating existing volume attachment record: 9f6c330c-b866-47b0-a785-dd196daae1f1 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:36:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:36:35 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:36:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.279674530029297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:36:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXanfSol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:36:40 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:36:40 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:36:40 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[94120bfc-01d3-434a-8e72-470a9ed2a16f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:36:40 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fb34ec-9f48-420c-ae0f-8c84fc1068c7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed] added
Aug 17 17:36:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e126fdbc-df69-43c6-8be2-8070a0f598c5]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[95407efa-c1cd-4e6f-80ff-5a61ee767183]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXanfSol {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXanfSol" returned: 0 in 0.025s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce0b3e7-4343-4546-8b8f-f3b7d0e3be5f]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXanfSol'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a3d2b2-854e-4b6f-b9f3-af0621d81073]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[4297018c-b82c-4ed8-a8e0-653370714e85]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:36:40 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:36:40 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:36:40 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:36:40 user nova-compute[72724]: 
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44a6e12-bddb-4308-8478-ab75e02e818a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260]
Aug 17 17:36:40 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260] successful.
Aug 17 17:36:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e60f312-9817-475f-bcad-93817261f10e]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3954e936-458f-4dcc-8b26-2de569783a39]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed (non-flash)
Aug 17 17:36:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed (non-flash)
Aug 17 17:36:40 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[311cd082-0ddf-4de9-88ae-e3a18d014e0e]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXanfSol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:36:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:36:41 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23862316632336336', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:36:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862316632336336', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:36:41 user nova-compute[72724]: DEBUG nova.objects.instance [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:36:41 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:36:41 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:36:41 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:36:41 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:36:41 user nova-compute[72724]:   <serial>f22382e9-befc-4de7-b0da-1f6ab26103ed</serial>
Aug 17 17:36:41 user nova-compute[72724]: </disk>
Aug 17 17:36:41 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:36:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:36:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:36:42 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No VIF found with MAC fa:16:3e:e9:ac:e4, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:36:42 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-79705222-23ac-46fe-ab9b-c3e5dd50d7b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.258s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:36:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:36:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:36:44 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:36:44 user nova-compute[72724]: INFO nova.compute.manager [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Detaching volume f22382e9-befc-4de7-b0da-1f6ab26103ed
Aug 17 17:36:44 user nova-compute[72724]: INFO nova.virt.block_device [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attempting to driver detach volume f22382e9-befc-4de7-b0da-1f6ab26103ed from mountpoint /dev/vdb
Aug 17 17:36:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Attempting to detach device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:36:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:36:44 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:36:44 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:36:44 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:36:44 user nova-compute[72724]:   <serial>f22382e9-befc-4de7-b0da-1f6ab26103ed</serial>
Aug 17 17:36:44 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:36:44 user nova-compute[72724]: </disk>
Aug 17 17:36:44 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:36:44 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config.
Aug 17 17:36:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:36:44 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:36:44 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:36:44 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:36:44 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:36:44 user nova-compute[72724]:   <serial>f22382e9-befc-4de7-b0da-1f6ab26103ed</serial>
Aug 17 17:36:44 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:36:44 user nova-compute[72724]: </disk>
Aug 17 17:36:44 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692293805.0788147, cc76070a-b519-41e3-a023-19bfa5dfac5e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:36:45 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config.
Aug 17 17:36:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXanfSol', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:36:45 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[201aa77c-b500-4d6c-b87e-e2cf7ee7e0b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73cbeaa-b1bd-4989-9c97-3c05284c427c]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed (non-flash)
Aug 17 17:36:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed (non-flash)
Aug 17 17:36:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c834fd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[231b3fc1-7554-470d-babe-a1e122a300cf]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2254669-e865-4c6c-83a5-c70f3d89ec35]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0b3b68-5271-45f1-87b8-268c86ea35d3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb62d6d0-437e-4864-9796-af2d7e9bb50c]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c38cf7-2b65-4232-9e93-dbf13b841ea7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ae8963-9829-4354-adf8-0a9ad7e3feda]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260]
Aug 17 17:36:45 user nova-compute[72724]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed, portal: 172.16.0.220,3260] successful.
Aug 17 17:36:45 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f22382e9-befc-4de7-b0da-1f6ab26103ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e66618-e9e3-4be9-9a47-7dc0ecd16cd0]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== disconnect_volume: return (272ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:36:45 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:36:46 user nova-compute[72724]: DEBUG nova.objects.instance [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:36:46 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-24b5d5ac-1b53-45d1-8015-6439ffff1c33 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:36:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:36:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:36:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:34 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:37:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8846MB free_disk=25.278823852539062GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:37:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:37:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:37:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:37:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:37:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:37:39 user nova-compute[72724]: DEBUG nova.objects.instance [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:37:39 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:37:40 user nova-compute[72724]: INFO nova.compute.manager [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attaching volume 618e3c76-3ab7-4097-85c1-96409519f9fa to /dev/vdb
Aug 17 17:37:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf9ead6-285d-4a78-8ef6-536d31ec5f1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:42292a17a61\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a32bd8d-58c5-4a7c-8018-a181268ad87a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[033b46c4-6949-42e3-a30a-2d1be8de3fd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[18300016-ba3d-4d3c-9640-bf2c153f54d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Running cmd (subprocess): nvme version {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] 'nvme version' failed. Not Retrying. {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.nvmeof [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] nvme not present on system {{(pid=72724) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 17 17:37:40 user nova-compute[72724]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c242ad-2cbd-42c7-ae9f-7345ed594705]: (4, '') {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72724) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.lightos [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] LIGHTOS: no hostnqn found. {{(pid=72724) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG os_brick.utils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:42292a17a61', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG nova.virt.block_device [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating existing volume attachment record: 3f4228a6-17f6-41d2-8ae0-b94dd8df5694 {{(pid=72724) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 17 17:37:40 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:37:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Calling os-brick to attach iSCSI Volume {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqJxbGVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:37:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:37:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:37:50 user nova-compute[72724]: INFO os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[a89534d1-3b5e-43bc-ac80-7b0d6e4b494d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 17 17:37:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --interface default --op new {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d8cd93-ce27-40ba-ba73-ff5739daa3c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa] added\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa] added
Aug 17 17:37:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ba3fe8-015b-4db9-ac7c-e3b82721a0a7]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[0116664d-e66b-41b9-9879-17a659dc1e81]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqJxbGVt {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sqJxbGVt" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe1018e-b86f-4f16-b9ff-28a62c182c0a]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sqJxbGVt'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[731172d6-0efa-4ba1-ad32-87b4a6a050e3]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[71159e0c-aa35-4a2b-becb-032ab08ad45d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:37:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 17 17:37:50 user nova-compute[72724]:  {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:37:50 user nova-compute[72724]: WARNING os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 17 17:37:50 user nova-compute[72724]: 
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --login {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[483fea8f-9021-431b-b37b-b05ff1957334]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260]
Aug 17 17:37:50 user nova-compute[72724]: Login to [iface: default, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260] successful.
Aug 17 17:37:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b84c18-415f-4735-af2c-b4da30f89513]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[9094c1f0-8225-4884-a32b-0b54a21b7966]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa (non-flash)
Aug 17 17:37:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa (non-flash)
Aug 17 17:37:50 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to 172.16.0.220:3260 {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=72724) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72724) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf19221-428d-4393-93b3-1cabda4d1133]: (4, ('- - 0', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:50 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72724) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqJxbGVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72724) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '23438303235393061', 'path': '/dev/sdb'} {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438303235393061', 'path': '/dev/sdb'} {{(pid=72724) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG nova.objects.instance [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:37:51 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] attach device xml: <disk type="block" device="disk">
Aug 17 17:37:51 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:37:51 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:37:51 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:37:51 user nova-compute[72724]:   <serial>618e3c76-3ab7-4097-85c1-96409519f9fa</serial>
Aug 17 17:37:51 user nova-compute[72724]: </disk>
Aug 17 17:37:51 user nova-compute[72724]:  {{(pid=72724) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vda, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72724) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] No VIF found with MAC fa:16:3e:e9:ac:e4, not building metadata {{(pid=72724) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-200c95a4-a1a4-43f2-814e-4682e2aee9b4 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.157s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:37:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:37:54 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:37:54 user nova-compute[72724]: INFO nova.compute.manager [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Detaching volume 618e3c76-3ab7-4097-85c1-96409519f9fa
Aug 17 17:37:54 user nova-compute[72724]: INFO nova.virt.block_device [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Attempting to driver detach volume 618e3c76-3ab7-4097-85c1-96409519f9fa from mountpoint /dev/vdb
Aug 17 17:37:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Attempting to detach device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config. {{(pid=72724) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 17 17:37:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:37:54 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:37:54 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:37:54 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:37:54 user nova-compute[72724]:   <serial>618e3c76-3ab7-4097-85c1-96409519f9fa</serial>
Aug 17 17:37:54 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:37:54 user nova-compute[72724]: </disk>
Aug 17 17:37:54 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:37:54 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the persistent domain config.
Aug 17 17:37:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config. {{(pid=72724) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 17 17:37:54 user nova-compute[72724]: DEBUG nova.virt.libvirt.guest [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] detach device xml: <disk type="block" device="disk">
Aug 17 17:37:54 user nova-compute[72724]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 17 17:37:54 user nova-compute[72724]:   <source dev="/dev/sdb"/>
Aug 17 17:37:54 user nova-compute[72724]:   <target dev="vdb" bus="virtio"/>
Aug 17 17:37:54 user nova-compute[72724]:   <serial>618e3c76-3ab7-4097-85c1-96409519f9fa</serial>
Aug 17 17:37:54 user nova-compute[72724]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 17 17:37:54 user nova-compute[72724]: </disk>
Aug 17 17:37:54 user nova-compute[72724]:  {{(pid=72724) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-3439df5e-d8c1-419e-8a97-bb566f2c22ef None None] Received event <DeviceRemovedEvent: 1692293875.027126, cc76070a-b519-41e3-a023-19bfa5dfac5e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72724) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.driver [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 17 17:37:55 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully detached device vdb from instance cc76070a-b519-41e3-a023-19bfa5dfac5e from the live domain config.
Aug 17 17:37:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] calling os-brick to detach iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f86e81da920>, {'target_iqns': ['iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sqJxbGVt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 17 17:37:55 user nova-compute[72724]: WARNING os_brick.initiator.connectors.base [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa', 0)] {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aefbc8e-4860-4c98-a353-c4640885022f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[92be909b-ac3e-454b-9fd8-f96d26618ea1]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa (non-flash)\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa (non-flash)
Aug 17 17:37:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa (non-flash)
Aug 17 17:37:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f86c86b8700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa'): ({'sdb'}, set())}) {{(pid=72724) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Removing single pathed devices sdb {{(pid=72724) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e069c78-86a0-4a8a-ae0e-231a0b086dd0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bab24b8-c709-419c-bf87-a2c2b6f7274c]: (4, ('ok\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Flushing IO for device /dev/sdb {{(pid=72724) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15a5c3d-7a89-45bc-aa6a-f4b2109cb1ed]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72724) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba831f11-e6b8-4038-803e-aa15b9497fcb]: (4, ('1', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.linuxscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] SCSI volumes sdb have been removed. {{(pid=72724) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa')] {{(pid=72724) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceced0ac-d455-4238-9867-b9ee9228c6bc]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --logout {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[373878c9-8f5f-486b-a78b-f4eeff305218]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260]
Aug 17 17:37:55 user nova-compute[72724]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa, portal: 172.16.0.220,3260] successful.
Aug 17 17:37:55 user nova-compute[72724]:  stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op delete {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:618e3c76-3ab7-4097-85c1-96409519f9fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83733) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2daee16-94c1-4453-9dad-4f85930912eb]: (4, ('', '')) {{(pid=83733) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72724) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.base [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] <== disconnect_volume: return (246ms) None {{(pid=72724) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 17 17:37:55 user nova-compute[72724]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Disconnected iSCSI Volume {{(pid=72724) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 17 17:37:56 user nova-compute[72724]: DEBUG nova.objects.instance [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'flavor' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:37:56 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-ebb58c82-2e0f-4226-bf60-c1d9fa923390 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.662s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:37:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:37:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:38:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:38:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:38:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:38:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:38:32 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:38:35 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:38:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:38:36 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8835MB free_disk=25.27785873413086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72724) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:38:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquired lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Forcefully refreshing network info cache for instance {{(pid=72724) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 17 17:38:37 user nova-compute[72724]: DEBUG nova.objects.instance [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lazy-loading 'info_cache' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:38:38 user nova-compute[72724]: DEBUG nova.network.neutron [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [{"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:38:38 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Releasing lock "refresh_cache-cc76070a-b519-41e3-a023-19bfa5dfac5e" {{(pid=72724) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 17 17:38:38 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updated the network info_cache for instance {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 17 17:38:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:39 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:38:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:42 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:46 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:47 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:49 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:52 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:38:57 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verify base images {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Image id 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 yields fingerprint b03bde4555170889934ac3c361a174084018845b {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 17:38:58 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] image 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 at (/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b): checking
Aug 17 17:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] image 7987af0c-3aeb-4281-9a1e-f00b1aa170d2 at (/opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b): image is in use {{(pid=72724) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] cc76070a-b519-41e3-a023-19bfa5dfac5e is a valid instance name {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] cc76070a-b519-41e3-a023-19bfa5dfac5e has a disk file {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 17 17:38:58 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 17 17:38:59 user nova-compute[72724]: DEBUG oslo_concurrency.processutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72724) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 17 17:38:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Instance cc76070a-b519-41e3-a023-19bfa5dfac5e is backed by b03bde4555170889934ac3c361a174084018845b {{(pid=72724) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8
Aug 17 17:38:59 user nova-compute[72724]: WARNING nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Unknown base file: /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Active base files: /opt/stack/data/nova/instances/_base/b03bde4555170889934ac3c361a174084018845b
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Removable base files: /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02 /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9 /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110 /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964 /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8 /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c871232697aa71f8c83f531dc998843db9129fdd
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27ac1c41475c80b463c51b9ce3f83ea57d688f02
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bb29c0123c8be72d4a12ef52e3a848b9e81dd8a9
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f5769c37d6f636295af51e8b6572129d80b984b
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/57254646b746b3b15377c8491a02e0e384061110
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/05fab0e04e893be685fde5a9a537b001931db964
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/bf4715ac9cd026e6818fb6988cfdb62cdd7633ce
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ea631c2ac436aa3e55b4e7befd1655ded6d390f8
Aug 17 17:38:59 user nova-compute[72724]: INFO nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ba095d4a14636514051aab865645cffb1499e31e
Aug 17 17:38:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verification complete {{(pid=72724) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 17 17:38:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verify swap images {{(pid=72724) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 17 17:38:59 user nova-compute[72724]: DEBUG nova.virt.libvirt.imagecache [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Verify ephemeral images {{(pid=72724) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 17 17:38:59 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:38:59 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances with incomplete migration  {{(pid=72724) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 17 17:39:02 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:07 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:12 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:17 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:19 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Cleaning up deleted instances {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 17 17:39:19 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] There are 0 instances to clean {{(pid=72724) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 17 17:39:22 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:27 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:30 user nova-compute[72724]: INFO nova.compute.manager [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Terminating instance
Aug 17 17:39:30 user nova-compute[72724]: DEBUG nova.compute.manager [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Start destroying the instance on the hypervisor. {{(pid=72724) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:30 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-85e51c2b-fdcd-45f4-b6e4-6b99a22221a6 req-f6e0f1ba-c7c3-43f6-b5f6-a3855a02fc33 service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-vif-unplugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-85e51c2b-fdcd-45f4-b6e4-6b99a22221a6 req-f6e0f1ba-c7c3-43f6-b5f6-a3855a02fc33 service nova] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-85e51c2b-fdcd-45f4-b6e4-6b99a22221a6 req-f6e0f1ba-c7c3-43f6-b5f6-a3855a02fc33 service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-85e51c2b-fdcd-45f4-b6e4-6b99a22221a6 req-f6e0f1ba-c7c3-43f6-b5f6-a3855a02fc33 service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-85e51c2b-fdcd-45f4-b6e4-6b99a22221a6 req-f6e0f1ba-c7c3-43f6-b5f6-a3855a02fc33 service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] No waiting events found dispatching network-vif-unplugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.compute.manager [req-85e51c2b-fdcd-45f4-b6e4-6b99a22221a6 req-f6e0f1ba-c7c3-43f6-b5f6-a3855a02fc33 service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-vif-unplugged-be57214d-a630-4ede-b697-694134e33a12 for instance with task_state deleting. {{(pid=72724) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Instance destroyed successfully.
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.objects.instance [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lazy-loading 'resources' on Instance uuid cc76070a-b519-41e3-a023-19bfa5dfac5e {{(pid=72724) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.virt.libvirt.vif [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-17T17:31:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-62967998',display_name='tempest-SnapshotDataIntegrityTests-server-62967998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-62967998',id=53,image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUuay5xOWMlq/cj81bnHy7jWjVxSvVvchMzezvmOrS/4FgqEtSYXUP8ut+d0C+1xVtos1ofNQshrHb4yIiWDKfqvW9u8jZM2QkT6GGyKuEj1K5pd2E5ncY2bRzz5wETJw==',key_name='tempest-keypair-1406052084',keypairs=<?>,launch_index=0,launched_at=2023-08-17T17:31:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b62c19ab817422b833051fd91eb229a',ramdisk_id='',reservation_id='r-c349z8py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7987af0c-3aeb-4281-9a1e-f00b1aa170d2',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1572416586',owner_user_name='tempest-SnapshotDataIntegrityTests-1572416586-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-17T17:31:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb7b05e32b741188c4c7f8947f41af4',uuid=cc76070a-b519-41e3-a023-19bfa5dfac5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Converting VIF {"id": "be57214d-a630-4ede-b697-694134e33a12", "address": "fa:16:3e:e9:ac:e4", "network": {"id": "8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1517251360-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.155", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b62c19ab817422b833051fd91eb229a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbe57214d-a6", "ovs_interfaceid": "be57214d-a630-4ede-b697-694134e33a12", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.network.os_vif_util [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6') {{(pid=72724) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG os_vif [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6') {{(pid=72724) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbe57214d-a6, bridge=br-int, if_exists=True) {{(pid=72724) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:31 user nova-compute[72724]: INFO os_vif [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:ac:e4,bridge_name='br-int',has_traffic_filtering=True,id=be57214d-a630-4ede-b697-694134e33a12,network=Network(8d8ef0a5-d0c8-4c47-b1a4-4e4b1224b9a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbe57214d-a6')
Aug 17 17:39:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Deleting instance files /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e_del
Aug 17 17:39:31 user nova-compute[72724]: INFO nova.virt.libvirt.driver [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Deletion of /opt/stack/data/nova/instances/cc76070a-b519-41e3-a023-19bfa5dfac5e_del complete
Aug 17 17:39:31 user nova-compute[72724]: INFO nova.compute.manager [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 17 17:39:31 user nova-compute[72724]: DEBUG oslo.service.loopingcall [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72724) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.compute.manager [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Deallocating network for instance {{(pid=72724) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 17 17:39:31 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] deallocate_for_instance() {{(pid=72724) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.network.neutron [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Updating instance_info_cache with network_info: [] {{(pid=72724) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 17 17:39:32 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Took 1.15 seconds to deallocate network for instance.
Aug 17 17:39:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.compute.manager [req-d9997624-8a00-4d9e-a7e0-24b9ca8155d3 req-9a43f9fb-ab24-4b29-9f0c-972dd7646fee service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-vif-deleted-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Refreshing inventories for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Updating ProviderTree inventory for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Updating inventory in ProviderTree for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Refreshing aggregate associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, aggregates: None {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 17 17:39:32 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Refreshing trait associations for resource provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1, traits: HW_CPU_X86_MMX,HW_CPU_X86_SSE42,HW_CPU_X86_SSE2,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_DEVICE_TAGGING,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_USB,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NODE,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_IMAGE_TYPE_AKI {{(pid=72724) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:33 user nova-compute[72724]: INFO nova.scheduler.client.report [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Deleted allocations for instance cc76070a-b519-41e3-a023-19bfa5dfac5e
Aug 17 17:39:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-161f152d-59e8-4f73-8d07-e7f9909b7133 req-8b343517-0d45-47ec-b85b-fc0634c9e07e service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received event network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-161f152d-59e8-4f73-8d07-e7f9909b7133 req-8b343517-0d45-47ec-b85b-fc0634c9e07e service nova] Acquiring lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-161f152d-59e8-4f73-8d07-e7f9909b7133 req-8b343517-0d45-47ec-b85b-fc0634c9e07e service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [req-161f152d-59e8-4f73-8d07-e7f9909b7133 req-8b343517-0d45-47ec-b85b-fc0634c9e07e service nova] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:33 user nova-compute[72724]: DEBUG nova.compute.manager [req-161f152d-59e8-4f73-8d07-e7f9909b7133 req-8b343517-0d45-47ec-b85b-fc0634c9e07e service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] No waiting events found dispatching network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 {{(pid=72724) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 17 17:39:33 user nova-compute[72724]: WARNING nova.compute.manager [req-161f152d-59e8-4f73-8d07-e7f9909b7133 req-8b343517-0d45-47ec-b85b-fc0634c9e07e service nova] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Received unexpected event network-vif-plugged-be57214d-a630-4ede-b697-694134e33a12 for instance with vm_state deleted and task_state None.
Aug 17 17:39:33 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-dcd5a861-b88f-4b73-abd2-e1898c153503 tempest-SnapshotDataIntegrityTests-1572416586 tempest-SnapshotDataIntegrityTests-1572416586-project-member] Lock "cc76070a-b519-41e3-a023-19bfa5dfac5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.491s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:39:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:39:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:39:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=25.304885864257812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:39:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:39:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:39:43 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692293971.5311072, cc76070a-b519-41e3-a023-19bfa5dfac5e => Stopped> {{(pid=72724) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 17 17:39:46 user nova-compute[72724]: INFO nova.compute.manager [-] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] VM Stopped (Lifecycle Event)
Aug 17 17:39:46 user nova-compute[72724]: DEBUG nova.compute.manager [None req-3a31d443-468d-40e3-8994-da814b6b7bc2 None None] [instance: cc76070a-b519-41e3-a023-19bfa5dfac5e] Checking state {{(pid=72724) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:39:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:39:51 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:39:56 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:01 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72724) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 17 17:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72724) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 17 17:40:06 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:40:11 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:40:16 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:21 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:24 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:26 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:28 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:31 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Starting heal instance info cache {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Rebuilding the list of instances to heal {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Didn't find any instances for network info cache update. {{(pid=72724) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager.update_available_resource {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:40:36 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Auditing locally available compute resources for user (node: user) {{(pid=72724) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 17 17:40:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:40:37 user nova-compute[72724]: WARNING nova.virt.libvirt.driver [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 17 17:40:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.30364227294922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72724) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72724) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG nova.compute.provider_tree [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed in ProviderTree for provider: 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 {{(pid=72724) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG nova.scheduler.client.report [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Inventory has not changed for provider 754b4011-d0b6-4fa1-8aed-3fbcbaa664d1 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72724) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG nova.compute.resource_tracker [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Compute_service record updated for user:user {{(pid=72724) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 17 17:40:37 user nova-compute[72724]: DEBUG oslo_concurrency.lockutils [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.276s {{(pid=72724) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 17 17:40:38 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:39 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_power_states {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:41 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:40:41 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:41 user nova-compute[72724]: DEBUG nova.compute.manager [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72724) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 17 17:40:42 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:45 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:46 user nova-compute[72724]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72724) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 17 17:40:47 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:48 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 17 17:40:50 user nova-compute[72724]: DEBUG oslo_service.periodic_task [None req-f58f87ff-0699-44dc-89d6-f17fb7a6f600 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72724) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}